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POLICY NOTIFICATION STATEMENT 



It is the policy of the Indiana Department of Education not to 
discriminate on the basis of race, color, religion, sex, national 
origin, age or handicap, in its educational programs or 
employment policies as required by the Indiana Civil Rights Act 
(I.e. 1971, 2291), Public Law 218 (I.C. 1971 Title 20), Titles VI 
and VII (Civil Rights Act 1964), the Equal Pay Act of 1973, Title 
IX (1972 Education Amendments), and Section 504 (Rehabilitation 
Act of 1973)- 

Inquiries regarding compliance with Title IX and Section 504 may 
be directed to the Personnel Director, Indiana Department of 
Education, 229 State House, Indianapolis, IN 46204, 317/927-0336, 




PREFACE 



In an increasingly technical and information-oriented society/ it is 
essential that students acquire the basic academic skills which are the 
tools for lifelong learning. The Indiana Basic CoiT^tency Skills Testing 
and Remediation Program has been established to assist schools in 
identifying students who experience difficulty mastering these critical 
skills and providing specialized instruction to promote their academic 
progress. Also, the program is intended to provide Indiana schools with 
another means of assessing their overall educational programs / in ordar to 
promote effective learning by all students. 

As is the case with any large-scale effort in its early stages, certain 
aspects of the testing and remediation program may seem confusing to 
educators at the local level. This manual has been constructed to assist 
cdministrators/ teachers and other school personnel in understanding and 
inplementinq the various coitponents of this program. In addition, it is 
hoped that the manual will be a helpful guide for anticipating and resolving 
problems associated with program iirplementation. 

As the testing and remediation program progresses, this manjal will be 
periodically revised and updated. In order to make the document as useful 
as possible, it will be inportant to obtain feedback from its consumers. 
Local educators are encouraged to recooiDend changes or additions to the 
manual which will increase its utility as a resource for conducting a 
program of the highest quality. 
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CHAPTER I 



Overview of the Testing and Remediation Program 
1.1 PURPOSE OF THE PROGRAM 

1.11 OVERVIEW 

The Indiana Basic Conpetency Skills Testing and Rernediation Program 
will examine a restricted domain in reading, mathematics and writing for 
Grades 3 and 6 and one other grade to be determined by the State Board of 
Education. The purpose of the test is to assist Indiana's educators with 
the in^lementation of remediation programs. The test will be given to all 
students in the designated grades during the last week of February each 
year. 

1.12 RATIONALE FOR THE PROGRAM 

The State Board decided that the test should include areas reported by 
the National Assessment of Education Progress (NAEP) in which students were 
found to be lacking skills. These areas include critical thinking, 
comprehension, mathematics problan solving, and persuasive writing. 

The Indiana Basic Competency Skills test has bf^n designed to 
supplement testing that is already going on in our schools. Most of the 
achievement tests used today are norm-referenced; a score indicates how well 
a student does in comparison to other students in the same grade. The state 
competency test is criterion-referenced; each sojre shows how well students 
have mastered each of a number of learning objectives. This additional 
criterion information will help schools design remediation programs v;hich 
address the specific skills found to be lacking for each student. The test 
will also have norms, derived from representative national and state 
samples . 

1.13 RELATIONSHIP OF THE IBCST TO THE EIP AND OTHER LOCAL ACHIEVEMENT 
TESTING PROGRAMS 

Districts have chosen their local testing programs to fit their 
curricula, which cover the core subjects (language, mathematics, science, 
social studies) and beyond. They have chosen achievement tests appropriate 
for all students, from low achieving to high. Given the limited domain of 
the statewide competency test, it might not be sufficient in depth and scope 
to provide the best reflection of a district's program. If, however, a 
district decides that the competency test does fit their program needs, then 
the district could use such scores to satisfy the achievement score 



reporting requirements of EIP for appropriate levels and subjects. Of the 
three areas — reading^ mathanatics, and writing— the writing scores may 
prove, in many instances, to provide better evaluations of writing than 
current local testing programs. 

Overall, the statewide competency testing program was designed to 
complement and supple^nent local testing programs and not to supplant them. 

1.2 PARTICIPANTS IN THE TESTING PROGRAM 

1.21 STUDENTS WHO WILL TAKE THE TEST 

All students in the designated grade levels in all Indiana public 
schools who receive their basic skills instruction from a REGULAR CLASSROOM 
TEACHER, are expected to take the IBCST. Students who receive their basic 
skills instruction from a SPECIAL EDUCATION-FUNDED TEACHER may be tested at 
the discretion of the local school district. However, special education 
students are not eligible for remediation according to Section l,c, (2) and 
(3) of H.E.A. 1202v Thus, these students' test results would be used only 
to review the appropriateness of their Individual Education Plaas. 

It is possible that some students may receive instruction in 
certain basic skills from a regular classroom teacher and receive other 
basic skills from a special education teacher (for the purposes of this 
program, BASIC SKILLS are defined as reading, writing and mathematics) . The 
local district may make one of three decisions regarding testing of a 
student in this situation: a) administer the entire test to the student; b) 
administer only those portions of bie test measuring skills the student 
receives from a regular classroom teacher; or c) exempt the student from 
taking the test. Note, however, that the students, would not be eligible 
for remediation under H.E.A. 1202. Results would be used to evaluate, and 
possibly revise, these students lEPs. 

1.22 CHAPTER 1 STUDENTS 

Chapter 1 students will be included in the testing program. 
Results may prove useful in documenting their need for Chapter 1 services. 
If these students score below the passing mark set by the State Board of 
Education then the district will have to decide whether or not to include 
them in state-funded remediation. See Sections 4.12 and 4.13, for 
discussions of aK>roaches to remediating Chapter 1 students. 

1.23 LIMITED ENGLISH PROFICIENT STUDENTS 

Limited English Proficient students will be expected to take the 
IBCST if they receive their basic skills instruction from a regular 
classroom teacher. Teachers must take into account that these students 
often lack English skills found to be important in many academic activities, 
including taking tests. Remediation plans for these children will need to 
be individually designed to meet their particular needs. 



1.24 STODEm.> IN OTHER SPECIAL PROGRAMS 

Consistent with the guidelines described in Section 1.21, 
students participating in other special programs (e.g., speech and hearing 
programs, physically handicapped programs) would take the test if they 
receive basic skills instruction in the regular classroom. 

If local district staff are uncertain as to whether a given 
student in a particular special program should be tested, they may call on 
the staff of the Department of Education for technical assistance. Also, 
please see Sections 4.14 and 4.15 for a discussion of considerations in 
deciding whether or not a student qualifies for remediation. 

1.25 STUDENTS IN NON-PUBLIC SCHOXS 

At this time, students enrolled in non-public schools are riot 
included in the testing and remediation program. Also, there is no 
legislative authority for non-public schools to arrange purchase or loan of 
the IBCST from the State of Indiana or the test developer. Should future 
legislative action include non-public schools in the program, further 
information will be provided by the Department of Education. 

1.3 COMMUNICATION AND USE OF TEST RESULTS 

1.31 HOT THE TESTS VJILL BE USED 

The purposes of Indiana's basic competency tests are five-fold: 

1. To provide the state a basis for statewide FUM);(NG of 
remediation; 

2. To provide school corporations a partial basis for 
SELECTING STUDENTS into the remedial programs; 

3. To INFORM those implementing the remedial programs of 
the areas within which each student needs assistance; 

4. To RETEST those in the remedial programs to gain a 
measure of their in4>rovement; 

5. To provide information helpful to school corporations 
about an ENTIRE GRADE LEVEL'S performance on the 
objectives. 

1.32 COMMUNICATING TEST RESULTS 

Each district will receive scoring reports from the contractor 
within a month of the date the tests are received by the scoring service. In 
addition to a funding report, referred to above, district offices will 
receive school, classroom and student reports (see Chapter 3 for 
descriptions of these reports). Trie district central office decides how and 
to whom it will communicate results. Section 1 (i) of H.E.A. 1202 states 
that the results of the test shall be made available only "to the student 
and the student's parent or guardian; or when required for use for purposes 
of thi^ section." The phrase "purposes of this section" is taken to refer to 
remediation described in Section 1. 
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CHAPTER II 



Adninistering the Test 



2.1 RECEIVING AND STORING TEST ^ATERIALS 

2.11 ARRIVAL OP MATERIALS 

Test materials are sent to eadi corporation central office during 
the first two weeks of February. The nuirber of tests sent is based on the 
number of third graders reported to the Department of Education/ via Form 
EIR-1, for the current academic year. Corporations which experience a 
significant change in third grade enrollment after submitting their EIR-1 
should contact the Division of Research and Assessment (317/927-0213) AS 
SOON AS POSSIBLE PRIOR TO FEBRUARY 1. 

2.12 TEST MATERIALS 

The following materials are included in the shipn^ents to 
corporation offices: 

TEST BOOKLETS: The number of booklets sOTt for testing each grade 
level equals the nurrber of students to be tested plus a five percentage 
overage. Booklets are packaged in groups of twenty tests. 

TEACHER^S MANUALS: Each package of twenty tests includes one 
tocher's manual. This manual contains instructions for administering the 
test and ccirpleting student data grids. 

GROUP INPOPMATION FORMS: The shipment includes one group 
information form for each class tested in tl^ corporation. This machine 
scannable form is green in color and calls for information concerning school 
and teacher name, nuirber of students tested in the class anu date upon which 
testing was started by the teacher* 

SCHOOL/GROUP LIST: At least OTe list is included in the shipnent. 
The list is used to report each grade level and class for which con5>leted 
tests are being returned. This allows the contractor to confirm that all 
tests intended for return by the corporation were actually included in the 
return shipment. 

RETURN LABELS: One box in the shipment contains a number of 
postage-paid return labels. When re-packaging ccxnpleted tests, a label 
should be affixed to each box in the return shipment. 
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INSTRUCTIONS FOR RETURNING CX3MPLETED TESTS; One box in the 
shipment contains a one-page sheet describing procedures for re -packaging 
and returning ccnpleted tests. 

SCANNABLE ANSWER SHEETS {Vpper rjrade levels only) : Each package 
of twenty tests includes twenty answer sheets. Students tested in grades 
OTHER THAN GRADE THREE must mark their answers on these madiine scannable 
sheets. However/ answer sheets will not be included in shipments for Grade 
Three/ as these students mark their answers directly in their test booklets* 

2.13 STORAGE OF TEST MATERIALS 

Prior to the testing dates/ all test materials should be stored in 
a manner and location which ensures their security. The Department of 
Education depends heavily on school corporations to maintain the security of 
test materials throughout the testing process/ as is the case for other 
standardized tests. 

2.2 SUGGESTED TESTING SCHEDULES 

2.21 ANNUAL TEST DATES 

The IBCST is designed for administration during the last week in 
February each year. Ideally/ the test would be given over three consecutive 
mornings/ according to the schedule below: 

Reading Vocabulary and Comprehension: Morning 1 
Mathematics: Morning 2 
Writinq: Morning 3 
Make-i3j^^: Morning 4 

2.22 ALTERNATE TEST DATES 

Certain situations may prevent test adrrinistration during the last 
week of February. In such situations/ the test may be given during the 
third week in February. Testing after March 1 creates several logistical 
problems in obtaining statewide results and should be avoided. 

2.23 TESTING SESSIONS 

The IBCST is designed to be given in seven sessions over the three 
day testing period. These sessions are broken down in Table 2-1 and Table 
2-2* 



Insert Table 2-1 
About iieire 
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Insert Table 2-2 
About Here 



2^3 ADMINISTERING THE TEST 

2,31 TESTING CONDITIONS 

The State Board ol Education recomiends that the designated 
district test person assume overall responsibility foir administering the 
test as well as collecting and mailing answer documents in a timely mannner. 
The State Board of Educaticxi further reccnroends that all such tests be given 
by the classroom teacher in the classroom to his or her students ^ according 
to uniform procedures outlined in the teacher's test manual. The State 
Board of Education reconinends against administering these tests in large 
groups collected in auditoriums^ lunchrooms/ or gymnasiums* 

2*32 TESTING PROCEDURES 

Testing procedures are described in the TEACHER'S MANUAL* The 
instructions for each subtest have been carefully developed to promote 
uniform understanding by students* It is essential that teachers precisely 
follow all testing procedures and read all instructions exactly as they are 
described in the manual, 

Siaggestions for administering the test are provided in Appendix A. 
Any questions concerning testing procedures may be directed to the Division 
of Research and Assessment/ Indiana Department of Educaticxi. 

2,4 RETURNING COMPLETED TESTS 

2.41 RETURN SHIPPING 

Conpleted tests should be returned to the contractor/ 
CTB/McGraw-Hill/ where they will be scored. The cost of returning tests 
will be assumed by the contractor. Unused test materials should be retained 
by corporations for future use. 

2.42 DEAMiINE FOR RETURNING COMPLETED TESTS 

It is important to note that statewide test results cannot be 
computed until all school corporations have returned ccnpleted tests. For 
this reason/ tests must be placed in shipment to the contractor no later 
than March 6 of each yeai!^ 
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2.43 MAKE-UP DATES 

The statewide funding report includes only those students 
conpleting all sections of the test. Corporations are asked to provide a 
make-up testing day for students who were absent during one or both of the 
scheduled test days. However, make-up testing should not delay the return 
of conpleted tests beyond March 6 of each year. 
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CHAPTER III 



Scoring Reports 



3.1 OVERVIEW OF SCORE REPORTS 

3. 11 RECEIPT OF REPORTS BY CORPORATIONS 

During the first two weeks of April, the contractor will mail 
scoring r^>orts to school corporation central offices. These reports will 
provide both norm-referenced and criterion-referenced information on 
performances by student, class, school, district, and state. Also a fundir^ 
report will be provided to assist corporations in claiming remediation 
funds. 

3.12 TYPES OF REPORTS 

Table 3-1 lists the various types of score reports, along with a 
brief description of each report and its recipient. 




Insert Table 3-1 
About Here 



3.2 DESCRIPTION OF SCORING REPORTS 

3.21 INDIVIDUAL SCORE REPORT 

Two copies of an Individual Score Report will be produced for each 
student taking the test. One copy is intended for use by teachers, while 
the other copy may be given to parents or retained in students' files. 

Table 3-2 illustrates the report. Significant features are 
described below and referenced to Table 3-2: 



Insert Table 3-2 
About Here 
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(A) Identifies the student for whan the report is intended, along 
with ^Jje^ student ^s 9^^^ ^vel, teacher, school and district. 

i 

(B) Indicates responses to the "special codes" (i.e.. Chapter 1, 
Special Education) and student identification. These codes 
are located on the cover of the test booklet (third grade) or 
on the answer sheets (other grades) . Using the code in Table 
3-2 as an illustration, the various digits are interpreted as 
follows: 



FIRST DIGIT: Indicates whether or not the student was 
reported to be enrolled in a Chapter 1 program. A "o" in 
this place indicates that student is in Chapter 1; a "1" 
indicates that the student is not in Chapter 1. 

SECOND DIGIT: Indicates whether or not the student was 
reported to be enrolled in a special education program. A 
"o" here indicates that the student is in special education, 
while a "1" indicates no participation in special education 
program. 

THIRD THROUGH SIXTH DIGITS: Indicates the identification 
number assigned to the student. This number should be 
retained in the student *s record for future reference. 

(C) Identifies the subtest (reading, matliematics, writing) for 
which scores are reported. 

(D) Identifies each objective measured in the subtest. 

(E) Number of correct answers on each objective, subtest and 
test as a whole. 

(F) Percentage of correct answers on each objective, subtest and 
test as a whole. 

(G) For the 1985 testing, this column will be blank. If the 
S tate Board of Educa ti on establ ishes s ta tewide mas tery 
criteria on the objectives, the column will report those 
criteria as proportions (e.g. 3/5, 4/5). 

(H) This column will be blank in 1985. If mastery criteria 
have been established by the State Board of Education, the 
column will indicate if the student achieved mastery on each 
objective. Mastery will be indicated by the symbol 
beside the mastered objective. Non-mastery of an objective 
will be indicated by the symbol 
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(J) Provided for the teacher to insert prescriptive/diagnostic 
notes or to indicate if the student has achieved criterion 
performance levels established by the school corporation. 

(K) Reports the nuniber and percentage-of-total-itens answered 
correctly on each subtest. 

(L) Reports the student's overall test perforinance/ in terms #f 
number and percent of items answered correctly. If the State 
Board of Education has established mastery criteria in 1986, 
this entry will report the total nuittoer of objective 
mastered. Note that the total number of correct answers 
reported here serves as the student's composite test score, 
used to determine if the student has exceeded the statewide 
cutoff score for remediation^ 



3.22 PERFORMANCE ANALYSIS REPORT BY CLASS (PARC) 

This report sumrrarizes performances by all students in a class on 
each objective and subtest, along with the entire test. The PARC is 
illustrated in Table 3-3. Significant features referenced on this report 
are described below: 



Insert Table 3-3 
About Here 



(A) Identifies teacher, school and district names. Also 
indicates grade level and number of students tested; 

(B) Columns describe performance of each student. The number of 
correct answers a given student obtains on each objective, 
subtest or total test is found by reading down that 
student's column; 

(C) Indicates the subtest (Reading, Writing, Mathematics) for 
which scores are reported; 

(D) Lists each objective measured by the subtest; 

(E) Indicates the number of correct answers on each objective; 

(F) Indicates the number and percent of correct answers on each 
subtest; 
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(G) Indicates the overall number and percent of correct answers 
on the total test. These are students' composite scores , 
used to determinne eligibility for remediation. 



3.23 PERFORMANCE ANALYSIS REPORT: SCHOOL SUhMARY 

This report summarizes test results by classes within a school and 
provides an overall picture of the school's performance. The report is 
useful for analyzing school -wide strengths and weaknesses on the perfonriance 
objectives and determining needs for curriculum changes. Significant 
features of this report, referenced to Table 3-4 , are described below: 



Insert Table 3-4 
About Here 



Identification information/ including school and district 
names, grade level, and test date; 

Names of subtests. 

Performance objectives measured by subtests. 

Number of items measuring each objective. 

Averaqe number of itews answered correctly on each objective 
and subtest by students in each class and the entire school. 

Average number and percent of itons answered correctly on 
each subtest. 

Average number and percent of items answered correctly on the 
overall test. 

3.24 PERFORMANCE ANALYSIS REPOEffs DISTRICT SUMMARY 

The district sumn^ary provides test results by each school within 
the corporation and summarizes overall corporation results. The report is 
structured in the same manner as the school summary and provides average 
scores on objectives and subtests, by school and corporation. The report is 
illustrated in Table 3-5. 



Insert Table 3-5 
About Here 




(A) 



(B) 
(C) 
(D) 
(E) 



(F) 
(G) 
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3.25 CLASS/ SCHOOL AND DISTRICT ITEM ANALYSIS REPORTS 



Item analysis raports will be provided for eadhi class and school 
in the corporation^ as well as the corporation as a whole. These r^rts 
are designed to help teachers , principals and other corporation personnel 
examine patterns of answers to the test questions. I tan analyses are useful 
for: a) determining percentages of students co^Lrectly answering questions; 
b) analyzing types of errors made on particular questic»is; and c) 
determining percentages of students skiE^>ing various questions. 

A Class Item Analysis Report is illustrated in Table 3-6. 
Significant features of the report are described below: 



Insert Table 3-6 
About Here 



(A) Identification information; 

(B) Performance objectives; 

(C) Items measuring each objective/ listed by item numbers; 

(D) Percent of students answering items correctly; 

(E) The letters of the correct responses to items; 

(F) Percent of students omitting questions; 

(G) Percent of students choosing each option on the items. The 
percent of students choosing the correct response on an itan 
is noted by the symbol , 

3.26 STATEWIDE AND DISTRICT FREQUENCY DISTRIBUTIONSA^ISTRICT FUNDING 
REPORT 

This repor t provides frequency dis tribu ti ons of subtest and 
coT^xDsite test scores for the state and corporation. Also reported are 
statewide: and local percentile ranks^ summary test statistics and number of 
students in the corporaticai obtaining composite test scores below the state 
cutoff. Corporations may utilize this information in preparing claims for 
renaediation funds. 

This report is illustrated in Table 3-7, with significant features 
described below: 
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Insert Table 3-7 
About Here 



(A) Identifies district for which the report is prepared^ along 
with the grade level and number of students tested. This 
section also indicates which form of the test (A or B) was 
used. 

(B) The left side of the report provides statewide results for 
the composite test, and reading, mathanatics and writing 
subtests (writing results will be included in 1986). 

(C) Lists raw scores obtained statewide on the test or subtests. 

(D) Lists number of students obtaining each raw score. 

(E) Lists percent of all students in the state obtaining a raw 
score. 

(F) Lists percent of students in the state obtaining scores up 
to and including a given raw score. 

(G) List percentile ranks associated with raw scores. Statewide 
percentiles are based on the state distribution of scores, 
while the district percentiles are based only on the 
district's score distribution. 

(H) The right side of the form provides the recipient school 
corporation's results on the con^xDsite test, as well as the 
reading, mathematics and writing subtests (writing results 
will be included in 1986) . 

(I) Sunroary statistics for the test are reported for the state 
(left side) and district (right side) . Statistics include: 

1. N-COUNT: Number of students tested; 

2. SPECIAL EDUCATION: Number of special education students 
who took all or a portion of the test, but who are not 
included in the score distributions; 

3. OMITS: Number of students who not con^)lete all 
sections of the test, and are not included in the score 
distribution; 

4. FREQUENCY N: Number of students included in the score 
distribution; 

5. MEAN: Average score on the test or subtest; 
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6. SD: Standard deviation; 

?• SEM: Standard error of measure* This statistic 
provides an index of the reliability of an individual 
student's scores. That is, if a given student took the 
test 100 times / 68 percent of her scores would fall 
within 1 SEM above or below her obtained score. The SEM 
reported for the state may be used with district scores. 

(J/K) FUNDING INPOFMATION: These «itries provide information 
needed to conplete the form for claiming ranedial funds. 
On the left side of the report/ Entry (J) indicates the state 
cutoff score for determining eligibility for remediation/ and 
the number of students in the state who obtained scores below 
the cutoff. This information is provided for coitf>arison 
purposes only. 



Entry (K) provides the same information based on the school 
corporation's result. The entry indicates the cutoff score 
and the number of students in the corporation who scored 
below the cutoff. THUS/ THE NUMBER OP CORPORATION STUDENTS 
SCORING BELOW THE CUTOFF CONSTITUTES THE NWBER OF STUDENTS 
FOR WHOM REMEDIATION FUNDS MAY BE CLAIMED. 

3.27 NATIONAL NORM-PJEFERENC£D RESULTS: THE CLASS RECORD SHEET 

The Class Record Sheet provides test performance on each student 
in a class / referenced against the performance of a representative national 
norm group. Results are described separately for eadi subtest as well as 
the cor^XDsite test. ThuS/ while previously described reports utilize 
students* raw score/ the CRS provides STANDARD scores on each student. 
Scores reported include: a) grade equivalent (GE) scores; b) national 
percentile ranks associated with the standard scores; c) national stanines; 
and d) normal curve equivalent scores. Significant features of the report/ 
illustrated in Table 3-8/ are described below: 



Insert Table 3-8 
About Here 



(A) Identification information; 

(B) Alphabetical listing of students* names; 

(C) Form of the test (A or B) used to test students; 

(D) Types of scores included on the report to the right of the 
initials. These include: 
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GE: Grade Equivalent Score 

NCE: Normal Curve Equivalent 

NP: National Percentile Rank 

NS: National Stanine 

(E) Scores are reported for each subtest and the composite test; 



3.28 WRITING SAMPLE SCORING REPORT 

Students' writing sarnples will be returned to their teachers with 
two scores ranging frcsn 0 (unscoreable) to 4 (exeniplary) . One score will be 
obtained holistically, the other by primary trait scoring. A narrative 
description of the score will also be included. These scores will be 
weighted and catibined with the reading, roatheroatics ^ and writing inechanics 
test scores in order to obtain a cacrposite score. This conposite score will 
be used for remediation funding purposes. Please refer to i^>pendix B for a 
sample scoring guide. 
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CHAPTER IV 



Administrative Aspects of the Statewide 
Remedial Program 



4.1 SELECTING STUDENTS FOR REMEDIATION 

4.11 STUDENTS OBTAINING TEST SCORES BELOW STATE CUTOFF 

Each year^ the State Board of Education will identify a cutoff 
conposite score. In each corporation, students who obtain con^xDsite scores 
below the cutoff will be eligible for remediation. 



The cutoff score and the amount of funds per student available for 



remediation will be communicated to corporations soon after the State Board 
of Education receives statewide test results. 

4.12 STUDENTS SELECTED FOR REMEDIATION VIA THE SUBSTITUTION OPTION 



It is possible that a student scoring below the state cutoff 



already receives appropriate remediation under another program (e.g.. 
Chapter 1) , or is not considered in need of remediation on the basis of past 
work or teacher judgement. In such cases / the school corporation has the 
option of substituting another student for placement in the program. 
Students may be substituted on the basis o£ classroom performance or teacter 
observation/ even though their conposite scores may be greater than the 
state cutoff score. 



The substitution option allows school corporations considerable 



flexibility in deciding which students would derive greatest benefits from 
the remedial program. However, selection of students for remediation under 
the provisions of H.E.A. 1202 must be guided by the following criteria: 



a) The total nuitiber of students selected for remediation must 
not exceed the number of students originally obtaining scores 
below the state cutoff. This means that if a student is 
placed into the program on a basis other than test score^ 
another student with a substandard score must be removed^ 
when claiming remediation funds. 

b) All students selected for remediation must have received 
their basic skills instruction from regular classroom 
teachers at the time they were tested. Students receiving 
basic skills instruction from special education teachers are 
ineligible to participate in the remedial program. 
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c) As part of their claims for fundsr school corporations must 
submit descriptions of procedures used to select students for 
remediation. This procedure is described in Section 4.21. 

4.13 SELECTION OF CHAPTER 1 STUDENTS 

Since many students enrolled in Chapter 1 programs are eligible to 
take the test, they also are eligible for remediation under the provisions 
of H.E.A. 1202. However/ the school corporation may decide that their 
Chapter 1 program satisfies these students' needs and that^ their 
participation in the state-^funded program constitutes a duplication of 
services. The school corporation may consider the substitution option (see 
Section 4.12) to select other students for the remedial program in place of 
the Chapter 1 students when appropriate. 

4.14 PROGRAM ELIGIBILITY TEST 

Certain circumstances may arise in which it is difficult to 
determine whether or not a student is eligible to participate in the testing 
and remedial program. If a question exists as to eligibility of a given 
student/ the following eligibility test may aid corporaticm staff members in 
arriving at a decision. 

At the time the corT?)etency test is to be given: 



YES NO 

QUESTION 1: Does the student receive SOME or ALL 

of his/her instruction in reading from a REGULAR 

CLASSROOM TEACHER? 

QUESTION 2: Does the student receive SOME or ALL 

of his/her instruction in mathematics from a REGULAR 

CLASSROOM TEACHER? 



QUESTION 3: Does the student receive SOME or ALL 
of his/her instruction in writing from a REGULAR 
CLASSROOM TEACHER? 



ANSWER QUESTION 4 ONLY IF THE ANSWER TO ANY OF THE ABOVE QUESTIONS IS "NO." 

QUESTION 4: If the student does not receive 
instruction in one or more of the above skill 
areas from a regular classroon teacher then 
are they provided by a SPECIAL EDUCATION 

FUNDED TEACHER? 

If the answers to Question One, Two and Three are "YES/" then the 
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student is is eligible to participate fully in the testing and remediation 
aspects of the program. 

If the answer to Question One, Two or Three is "NO," and the answer to 
Question 4 is also "NO," then the student is eligible to participate fully 
in the program. 

If the answer to Question One, Two or Three is "NO" and the answer to 
Question 4 is "YES," then the student may take the test, but is not eligible 
to receive remediation under the state-funded program. 

4.15 TREATMENT OF STUDENTS RECEIVING BOTH REGULAR CLASSROOM AND SPECIAL 
EDUCATION INSTRUCTION 

A student who receives instruction in one or more basic skill 
areas from both a regular classroom teacher and a special education teacher 
would be ELIGIBLE to take the test and receive remediation, according to the 
eligibility test. However, eligibility in this case does not necessarily 
mean that program participation is in the best interest of every student 
receiving dual services. Local school corporations must assume the 
responsibility fOi.- deciding if participation in the remediation program 
would be in the student's best educational interest. This decision should 
involve the stijdent's regular classroon teadiers, special education teacher, 
principal, guidance counselor, school psychologist and other resource 
personnel having knowledge of the student's academic progress. Equally 
inportant, the decision must involve the student's parents or guardians. 

If such a collaborative decision-making process concludes that the 
student's educational interest would be better served by not including 
him/her in the remedial program, then the school corporation must plan and 
iitplement an appropriate alternative instructional strategy. While several 
opUons may be developed, three strategies are presented below as examples: 

a) Administer the cortfjetency test, indicating that the student 
is a special educaticxi enrollee (by marking "YES" in the 
SPECIAL EDUCATION column on the test booklet cover). 
Accordingly, exanpt the student from remediation as a special 
education enrollee. Use test results to evaluate, and 
possibly revise, the student's lEP. 

b) Administer the competency test, indicating that the student 
is not a special education enrollee (by marking "NO" in the 
SPECIAL EDUCATION column on the test booklet cover) . Exempt 
the student from the remediation program via the 
substitution option. Record the reasons for substitution in 
the student's permanent record. NOTE T«AT REASONS CITED FOR 
SUBSTITUTION MUST BE CONSISTENT WITH THE CORPORATION'S 
CRITERIA FOR SELECTING STUDENTS INTO THE REMEDIATION PROGRAM. 
Use test results to evaluate and modify the student's lEP. 

c) Exenpt the student from taking those portions of the test 
which, in the corporation's judgnent, will not provide 
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accurate or useful information about the stucSent's needs* 
Exenipt the student from the remediation program as a special 
education or substituted student. Describe the rationale for 
this decision in the student's permanent record. Use results 
of those portions of the test which were administered for 
planning appropriate instructional programs. 



4.2 APPLICATION FOR REMEDIATION FUNDS AND USE OF FUNDS 

4.21 APPLICATION FOR REMEDIATION FUNDS 

As soon as corporations receive the funding .report from the 
scoring service^ district test persons will know the nunbers of students 
scoring below the state cutoff score. This information will enable the 
school treasurer to con^>lete the front of the claim-for-funds report. On 
the reverse side, the district test person will need to provide a brief 
description of the corporation's plans for spending the remediation fundS/ 
as well as other information called for ty tlie form^ The Icscal 
superintendent's authorization in Section III of the claim form applies to 
the claim for funds, the remedial program description and/ if needed/ a 
waiver for a fall program. This claim form is illustrated in Appendix C. 

The State Board of Education's approval in Section IV applies to 
the claim for fundS/ the remedial program description and/ if necessary/ the 
waiver request for a foU program. 

4.22 USES OF REMEDIATION FUNDS 

Clearly/ remediation funds must be spent to defray costs of 
remediation described in H.E.A. 1202. Indeed/ Section 1 (h) requires the 
local superintendent to certify in writing before October 1 of each year 
that "funds (received under this section) have been used for purposes 
provided in this section." 

The appropr iat i cxi to suppor t the ccxipe tency tes t ing and 
remediation program was based on the amount needed to reimburse average-paid 
professional teachers to work with 10 students per hour for one sanester. 
If a district has met/ or made a bona fide attempt to meet/ this standard 
and has funds remaining that are insufficient to hire another teacher/ then 
such funds may be used to pay for other associated costs / including supplies 
and equipment. 

4.23 TRANSPORTATICM COSHS 

Remediation funds may not be used to provide transportation for 
students in the program. Even if program funds remain after a teacher has 
been hired/ the extra funds may not be applied to transportation costs. Jf 
a school corporation needs to transport a number of students to a suainer 
program/ but cannot afford to provide that transportation/ then the 
corporation should apply for a waiver to conduct a fall remediation progran. 
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A situation might arise in which only a few stucJents selected for 
sunmer reniediation may have transportation picoblenis. In this situation^ the 
corporation might select the following strategies: 

a) Provide a summer program to the majority of students and a 
fall program to the remaining students unable to attend in 
the summer. 

b) Provide a fall prograv^ for all eligible students. 

4.24 CORPORATION ALTERNATIVES WHEN REMEDIATION FUNDS ARE INSUFFICIENT 
TO HIRE A TEACHER 

The legislature's appropriation for remediation was intended to 
pay for a professional teacher to work with 10 students per hair in 
cooperation with the regular classroom teacher. 

A district whose third graders' average performance matched the 
state as a whole ^ i.e.^ with 15 percent of the third grade scoring below the 
state standard^ would need a third grade enrollment of nearly 290 in order 
that 15 percent of them would generate about $10^000 — the average salary 
of a teacher for one semester. What^ then^ is a district to do with amounts 
less than $10^000? The Board of Education recownends these options for 
local district consideration: 

1. Combine funds with neighbor districts for joint projects. 

2. Coiibine with other program funds that support like programs. 
Keep records in sufficient detail to account for children 
served and types of remedial services provided by the 
additional funds. 

3. Conibirie with sumn^er school funds. In this case^ the amount 
claimed for the remediation program must be subtracted from 
the sumnrier school reimbursement claim. 



4,3 ADMINISTRATION OF LOCAL REMEDIAL PROGRAMS 



4.31 WHEN REMEDIATION MAY TAKE PLACE 



Remediation programs will be provided in a sumi>er school program 
of at least four weeks. The State Board of Education strongly prefers that 
these programs be offered in the sunmer. However/ if a sumn^er program is 
not feasible^ the State Boards upon request of a school corporation^ may 
approve the substitution of an equivalent remediation program to be 
provided during the subsequent fall semester. At the end of the remedial 
program^ each participant will be retested using an equivalent form of the 
Basic CaT^>etency Skills Test. Beyond these observations^ the State Board of 
Education prefers not to recorrmend the number of weeks ^ days per week/ or 
hours per day for suitrner school or fall semester. Rather ^ it leaves these 
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matters at the local district level, where such decisions are best made in 
light of local conditions and resources. 

Whether remediation is carried out in the suniner or fall, the 
student's regular classroom activities are the most iniportant aspect of his 
or her education. If a student is to re-ceive appropriate remedial 
instruction, results from the statewide competency test plus additional 
diagnostic ineasures, such as informal reading inventories, regular classroon 
teacher comments and checklists should be collected and forwarded to the 
suniner school remedial teacher. This information forms a basis for planning 
appropriate remedial activities on a student-by-student basis. At the end 
of the sunnier instruction, the remedial teadier should prepare a report of 
each student's progress and forward the report to the regular classroom 
teacher who will have the student in the fall. This en5)hasis on 
conmunication with the regular classroom teadier focuses continued 
responsibility for the education of a student on the regular classroom 
teacher. 

4.32 RETESTING STUDENTS UPON PROGRAM COMPLETION 

At the completion of summer and fall remediation programs, 
students should be retested. Retesting will be done with the alternate form 
of the IBCST, which should be administered as soon as possible after the 
final remedial contacts with students. 

Tests will be ordered by the state for each corporation, based on 
the number of students reported on the corporation's claim fom. 
Corporations will receive the needed tests by August of each year. 

4.33 RETURN OF RETEST RESULTS 

Retest results will arrive in corporation central offices within 
thirty days after completed tests are mailed to the contractor. Results 
will include individual score reports, summary reports for all students in 
the program and an item analysis/sunmary statistics report based on group 
results. 

4.34 USE OF RETEST RESULTS IN PROMOTION DECISIONS 

The school corporaticxi staff will make the final decision about 
advancement to the next grade. For students in summer remediation, staff 
will base this decisicxi on the following considerations: a) the results of 
the student's retest; b) attendance in the remedial program; c) the 
student's teacher in the remediaticxi program; and d) the recommendation of 
the student's regular classroom teacher. 

4.35 IN-CLASS VERSUS PULL-OUT REMEDIATION PROGRAMS 

As a general rule, it can be argued that where reroediatiai occurs 
is not so ini)ortant as the quality of remediation. However, research 
findings in studies of ESEA Title I Programs indicate that pull-out programs 
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may be counter-productive. These programs remove pupils from regular 
classrooms to give them concentrated training. Peterson holds that pull-out 
programs are "constitutionally dubious/ educationally questionable, 
insuK>or table by the evidence from most evaluations,* He acknowledges 
some benefits from small classes and tutoring, although these benefits come 
at the expense of other values. Students lose touch with the regular 
classroom while ^xalled out. They spend time coming and going and may suffer 
the stignaa of special treatment. 

Peterson goes on to cite evaluations of pull-out programs 
conducted by Cooley and Leinhardt. They found pull-out programs 
"considerably less efficacious than programs integrated into the regular 
classroom experience." Glass and Shtith concluded "that they are not 
educationally sound." They found no evidence that pull-out programs 
improved achievement and plenty of evidence "that the unintended negative 
side effects of labelling students are large and worrisome*" 

Peterson argues that pull-out programs are legally suspect, 
especially in racially mixed schools where a disproportionate share of one 
or more racial groups may be pulled out. 

Perhaps the most conpelling argument for in-class remediation is 
that the regular classroom provides a better opportunity for a more 
imtnediate response to students needs. Pull-out is a gross response; whereas 
in-class is a more fine-tuned response, wherein the regular classroom 
activity remains as the overriding environment experienced by the student* 

If a school district decides that a pull-out program is the most 
feasible approach to take in providing remediation, then great care should 
be exercised to ensure that the remedial activity is closely coordinated 
with regular classroom instruction. Students should not come to feel 
stagnatized by the physical act of removal from the regular classroom during 
the remediation activity* 

All of this is not necessarily to rule out the use of pull-out 
programs of remediation. Research findings are not meant to govern program 
decisions but rather to inform the decision-maker so that he or she can take 
them into account in arriving at decisions. 



Peterson, Paul E., MAKING IHE GRADE, pp. 101-105, Twentieth Century Fund, 
Incl, 1983. 
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CHAPTER V 



Planning Reniedial Programs 
for the Indiana Basic Conpetency Skills 'Jtest 



5-1 OVERVIEW 

5.11 REQUIREMENTS OP H.E.A. 1202 

In accordance with H.E.A. 1202, "The governing body of a school 
corporation shall develop and inpleroent a program of basic conpetency skills 
remediation for students who need remedial work in basic conpetency skills*" 
In conpliance with this law, the Indiana Basic Conpetency Skills Test was 
developed to examine a restricted domain in reading, writing and 
mathanatics. This test was designed to assess students* basic skills in the 
following areas: 

READING - meaning vocabulary, literal conprehension, inferential 
comprehension, and critical reading/ thinking; 

MAIHEMATICS - concepts, computation, and problem-solving and 
application; 

WRITING - overall writing ability through a direct assessment of 
writing skills and an indirect assessment of writing^ siibskills, 
such as grairmar, punctuation, spelling and capitalization. 

Students who receive composite test scores below the state 
standard, prescribed by the State Board of Education, are eligible for 
state-funded remedial programs, sponsored by local school corporations. 

Local school corporaticxis are responsible for designing remedial 
programs which meet the needs of identified students. According to Sectiai 
2 of H.E.A. 1202, "Remedial programs. . .shall be provided in a summer school 
program of at least four (4) weeks.... However, the State Board of 
Education, upon request of a school corporation, may approve the 
substitution of an equivalent program of remediation that will be provided 
in that school corporation during the fall semester...." In keeping with 
legislative intent, the State Board of Education perfers that local 
districts offer remediation in the summer. 

5.12 STRUCTURE OF THIS CHAPTER 

This chapte;: provides general information and guidance to local 
school corporations for designing effective remedial programs. It provides 
information which may be useful for school administrators, directors of 
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testing and renedial programs and teachers of remedial students for 
designing programs which meet the needs of students, satisfy the 
requirements of the law, and are cost effective/affordable. Specifically, 
this report provides the following information about remedial programs: 

* COMPONENTS 

* ALTERNATIVE MODELS 

* CHARACTERISTICS 

* PLANNING PROCESS 

5.2 COMPONENTS OF REMEDIAL PROGRAMS 

5.21 SUMMARY OF PROGRAM COMPONENTS 

A remedial program is one which determines each student's 
knowledge deficiencies and provides instruction designed to assist students 
in overcoming the identified deficiencies. A renedial program includes 
three basic components: identification, diagnosis, and instruction. 

5.22 IDENTIFICATICW COMPONENT 

The identification corponent of the remedial program will be the 
Indiana Basic Corpetency Skills Test developed for reading, writing and 
mathematics. The minimum acceptable scores determined for the Indiana Basic 
Competency Skills Test will be used for the initial designation of students 
who need remediation. If a student in this group already receives remedial 
help under another program or is not considered to require remedial help on 
the basis of past school work, another student may be selected for the 
remedial program. The selection of the replacement student is left to the 
discretion of the local school corporation. Whether a school corporation 
uses additional testing, classroom performance and/or teacher nomination, it 
is recanmended that the selection procedure be as systematic as possible to 
ensure that all students needing help have equal and fair access to the 
remedial program. 

5.23 DIAGNOSTIC COMPONENT 

The Indiana Basic Conopetency skills Test will provide individual 
profiles of student performance in specific skill areas covered by the test. 
Thus, the ideitification component also will yield seme initial diagnostic 
information. School corporations will want to use additional diagnostic 
procedures to determina specific deficiencies and to assess knowledge and 
skills unique to their curriculum. 

5.24 INSTRUCTIC»IAL COMPONENT 

The instructional coiponent of the remedial program will include 
the appropriate teaching activities developed by school corporations to help 
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students overcome their deficiencies. The skill areas to be covered by the 
ren^edial program will include the areas measured by the Indiana Basic 
Cotpetency Skills Test and any additional corppetencies that are based on the 
local school corporation's existing programs. The method in which the 
remediation will be provided will vary according to the resources of the 
local school corporation. Several alternative models of remedial programs 
follow. 

5.3 ALTERNATIVE MC»ELS FOR REMEDIAL PRCX5RAMS 

5.31 CONDITIONS AFFECTING PROGRAM PLANNIIW 

In planning remedial programs, local school corporations have a 
number of alternative models from which to select. Ideally, each school 
corporation would receive sufficient funds to hire a fuil-tiine professional 
teacher to be responsible for the remediation of a small group of students 
that would number no more than ten at a time. Additionally, it is the 
intent of H.E.A. 1202 and the desire of the State Board of Education that 
tlie remediation programs be provided in summer school. In reality, however, 
the exact design of the program will depend on the existing conditions in 
the school, including such things as number of students to be served, number 
of classes, availability of special reading and/or mathanatics teachers, 
availability of ancillary personnel, amount of money allotted for 
remediation, etc. The design of the program will also depend on whether the 
program is planned for the suniner or fall and whether it is sponsored 
entirely by one school corporation or jointly by neighbgring corporations 
which combine funds. In deciding on appropriate instructional plans, it is 
recommended that a designated task group be assigned this responsibility. 
After considering individual circumstances and conditions, the task group 
might consider selecting one or a combination of the following suniner or 
fall program options. 

5.32 PLAN I - DESIGN A NEW REMEDIAL PROGRAM 

New remedial programs can be developed for either simmer or fall 
to help identified students strengthen their skills and overcome their 
deficiencies. Such programs should be planned around the "Characteristics 
of Remedial Programs" discussed in the next section and may consist of 
components from other alternative plans, such as computer-assisted 
instruction. Such programs should also employ professional teachers when 
resources permit and should maintain low pupil-teacher ratio. These 
programs should be closely coordinated with the regular classroom program. 

5.33 PLAN II - COMBINE WITH EXISTING SPECIAL AND SUMMER SCHOOL PROGRAMS 

Existing special programs, such as Chapter 1, locally funded 
reading and/or matheniatics programs, and summer school can accommodate the 
new state remedial program described in this publication. In cases where 
this is done, the host program should meet the needs of the students 
identified by the state competency test. Also, separate records should 
account for the additional students served by the additional funds, as well 
as the type of remediation provided. 
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5.34 PLAN III - USE AVAILABLE READING, LANGUAGE ARTS, AND MATHEMATICS 
SPECIALISTS 

In schools where reading, language arts and/or mathenatics 
specialists are available these individuals can be given the responsibility 
of working with the classroom teachers to develop the reinedial program for 
those indivi '...Is who need such instruction. If students are taken out of 
the classroa\ for remedial instruction during the fall, the external program 
should parallel and support the classroon instruction. 

5.35 PLAN IV - REMEDIATE WITHIN THE REGULAR CLASSROOM WITH THE REGULAR 
TEACHER 

Schools which do not receive sufficient funds to hire a 
professional teacher for remediation may choose to provide remediation 
during the fall in the regular classroom with the regular classroom teacher, 
with additional APPROPRIATE INSTRUCTIONAL MATERIALS. Once students who are 
in need of remediation have been identified, classes may be reorganized to 
make it possible for teachers to carry out more effective remedial 
instruction; for example, the students in need of remediation may be equally 
distributed across several classrooms to enable than to receive maximun 
individual attention from the teacher. 

5.351 USING TUTORS 

A tutorial program using tutors, e.g., college or university 
students who are studying elementary education, English, mathematics, etc. 
can be used to assist the regular teacher in implementing the remedial 
program. The tutorial program should correlate with classroom instruction 
and be supervised by the classroon teacher. The tutorial program should be 
viewed as extra instructional support beyond that which is given in the 
classroon. 

5.352 USING AIDES OR VCtUNTEERS 

Under this plan all remedial instruction can be carried out 
within the regular classroom under the direction of the classroom teacher 
who is supported by aides or volunteers. All initial teaching is provided 
by^ the teacher with the aides or volunteers supervising guided practice, 
independent practice and application activities of skills and processes 
taught. 

5.36 PLAN V USE COMPUTER^ASSISTED INSTRUCTION 

Where sufficient cortputer resources are available or where funds 
are available for the purchase of carpi ^:er resources and APPROPRIATE 
SOFTWARE is available, computer-assisted instruction may be used to 
supplement the necessary teaching, practice and application activities to 
remediate students' deficiencies. An in-classroom approach or conputer 
laboratory approach may be used to carry out instruction. If available 
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software does not provide the necessary teaching, the classroom teacher or 
special teacher should provide such instruction followed by 
coitputer-assisted drill and practice. 

5.4 CHARACTERISTICS OF REMEDIAL PROGRAMS 
5.41 OVERVIEW 

No matter which of the above models or coitibinations of models are 
chosen, the instruction provided should contain the characteristics of an 
effective instructional program. 

A successful program has these characteristics, whether the locus 
IS a remedial setting or a regular classrocm, and involves the teacher's use 
of the diagnostic-prescriptive model. Diagnostic-prescriptive teaching 
means that the teacher assesses the learner's strengths and needs and then 
attempts to prescribe the best possible activities and materials to help the 
learner improve in specific skill areas. 

The diagnostic-prescriptive process is a definite sequence of 
steps planned and inplemented by the classroom teacher to overcome skill 
deficiencies. This is inevitable if the teacher constantly reexamines and 
selects instructional activities to match the needs and progress of the 
learner. (For a detailed discussion of diagnostic-prescriptive teaching, 
see Cooper and Worden, 1983; Cheek and Cheek, 1980; and Reisman, 1978.) 

According to Cooper (1983) the diagnostic-prescriptive teaching 
process includes six steps. These steps are the following: 

1. GAMER RELEVAf'JT BACKGROllND INFORMATION; 

2. HYPOTHESIZE POSSIBLE REASONS FOR A STUDENT'S STRENGTHS AND 
WEAKNESSES; 

3. GENERATE ALTERNATIVE ACTIONS AND MATERIALS; 

4. EVALUATE ALTERNATIVES AND SELECT THE ONES BEST SUITED FOR THE 
STUDENT; 

5. TEACH THE SKILLS; 

6. EVALUATE RESULTS. 

Using the global framework of the diagnostic-prescriptive model, 
research findings indicate that a succesful instructional/remsdial program 
includes, but is not limited to, the following characteristics: 

1. USES OIGOING EVALUATIVE PROCEDURES; 

2. SPECIFIES LEARNER OBJECTIVES; 
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3. PROVIDES APPROPRIATE, SEQUENTIAL INSTRUC:iONAL ACTIVITIES AND 
MATERIALS; 



4. PRESENTS SKILLS IN CONTEXT OF SUBJECT AREA? 

5. CORRELATES WITH AND SUPPORTS ONGOING CLASSROOM PROGRAM, I.E., 
ARTICULATES WITH DEFINED CURRICULUM; 

6. MEETS INDIVIDUAL DIFFERENCES. 

These six characteristics of an instructional/remedial program 
will be treated separately in the following sections. Specific applications 
to reading, writing and matheniatics will be included when appropriate. 

5.42 USES ONGOING EVALUATIVE PROCEDURES 

An effective instructiaial/renedial program includes the use of 
both formalized testing procedures and informal measures, consistent with 
the needs of the learner. 

Diagnosis in mathematics may include the use of an interview 
technique in which the teacher-diagnostician determines the process by which 
a learner arrives at an answer. Based upon the learner's verbal responses, 
the teacher is provided with inportant information for selecting ranedial 
strategies, e.g., response mode from concrete to abstract. (For further 
informata.on regarding diagnosis in mathematics, consult Uprichard, 1974; 
Glennon and Wilson, 1972; and Copeland, 1974.) 

In reading, such informal diagnostic measures might include 
administering an informal reading inventory, paper and pencil tests, daily 
work sanples, and systematic teacher observations as a means of determining 
student need and measuring growth. An effective reading program will 
utilize both formal and informal diagnostic techniques. 

Diagnosis in writing might include observation of the student 
during the whole process of composing, frequent and systematic conferences 
with students at different stages of cart>osing, use of con^xjsing-aloud 
protocols and error analysis of the student's writing. 

5.43 SPECIFIES LEARNING OBJECTIVES 

The instructional program should include a ccnponent that 
identifies and sequences clearly specified objectives which learners are to 
achieve. 

Research (Guthrie, 1976) indicates that successful instructional 
programs have generally set an expected level of performance, e.g., 80%, for 
learner djjectives. Further, such programs included built-in checks to 
determine if the learner had mastered the djjectives. 
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5.44 PROVIDES APPROPRIATE INSTRUCTIONAL ACTIVITIES AND MATERIALS 

Matching a student with the appropriate difficulty level of 
activities and materials is another aspect to consider in ensuring 
successful learning for the child. When students are provided with 
appropriate instructional materials, effective learning generally follows. 

The instructional program must include a canf>onent where the 
teacher teaches or models the concepts, skills or processes as opposed to 
having students practice what they do not know. 

Research evidence indicates that teachers frequently do not model 
or teach corprehension skills or processes or ask students questions to test 
them. Therefore, to prevent or correct deficiencies for students, the 
skills or processes must be taught and modeled for them. Many students have 
such deficiencies because the needed skills and processes have not been 
taught. 

Thus, students should interact with materials appropriate to their 
abilities, i.e., learners should be placed in content materials which match 
their instructional reading levels. For exan4)le, use an informal reading 
inventory to secure that information. Using a standardized reading test to 
determine a student's placement level for instruction is inappropriate 
according to Farr (1970). For mathematics and writing, materials and 
activities appropriate for instruction could be determined by the informal 
diagnosis described in Section 5*42, above. 

5.45 PRESENTS SKILLS IN CONTEXT 

In an ins true tioiai/remedial program, skills should, as often as 
possible, be taught, practiced and applied in the context of a particular 
subject area. Reading and writing are processes, not sums of skills to be 
mastered in isolaticxi. Isolated skill mastery does not necessarily improve 
the student's overall reading or writing abilitr/ (Haley-James, 1981). 

In mathematics, problon-solving and application situations should 
be systonatically used to dmonstrate relationships between concepts and 
con^wtational skills. In such problem-solving situations, Driscoll (19801 
suggests two reasons why students should use calculators. First, the 
learner is more able to concentrate on the problem-solving process, and 
secondly, he or she is not bogged down by difficulties with carputational 
skills. 

5.46 CORRELATES WITH ONGOING CLASSROOM PROGRAM 

Regular classroon teachers should be involved in the planning of 
remedial activities and strategies for their students. Any remediation 
component should, as much as possible, articulate with the philosophy, 
instructional activities and materials used in a student's regular classroom 
program (Guthrie, 1976; Englehardt, 1976; and Reisman, 1978). 
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5.47 MEETS INDIVIDUAL DIFFERENCES 



A teacher in an effective instructional/remedial program should 
consider certain psychological and social principles* For exanple, 
according to Squires (1983) a student's feeling of success is a prerequisite 
for effecti'/e learning, AlsO/ Reisman (1978) indicates that the research is 
inconclusive as to whether failure in a subject area is the cause or the 
effect of student's emotional problems* Peterson^ (1983) discusses the 
stignia often attached to those students who require special treatment* 

Alternative modes and methods of teaching also provide 

c^jportunities for meeting individual student needs In helping the student 

develop reading or writing skills, for exanple/ the teadier should model 
such skills (Durkin^ 1978)* 

The instructional program should include an in-service conponent, 
if at all possible, to insure that all teachers and ancillary personnel have 
current/ up-to-date knowledge about the teaching of reading, writing, and 
mathematics. An inportant part in helping students overcome their 
deficiencies depends on helping teachers identify appropriate instructional 
strategies to utilize with their students. 

5.5 PROCESS OF DESIGNING REMEDIAL PROGRAMS 

The following steps are recormended for planning, organizing and 
implementing remedial programs. 

5.51 STEP I - DEFINE THE SKILLS OR TASKS THAT WILL BE TAUGHT 

For each of the areas tested by the Indiana Basic Cortpetency 
Skills Test, list the skills or tasks that will be taught. This listing 
should be based on the school's existing reading, writing and mathematics 
program philosopl^ and design. 

5.52 STEP II - IDENTIFY THE STUDENTS TO BE SERVED 

Using the results of the Indiana Basic Competency Skills Test, 
identify the students who have not achieved the minimum acceptable scores 
along with the specific skill areas where instruction is needed for each. 

5.53 STEP III - C»IPUTE AVAILABLE DOLLARS TO BE RECEIVED TO SUPPLEMENT 
THE EXISTING PROGRAM 

The amount of additional dollars available to a school corporation 
for remediation will be based on the number of students below minimum level 
multiplied by the per student dollar amount. Exact per student dollar 
amount will not be known until testing is completed. 
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5.54 STEP IV - STATE THE OBJECTIVES OP THE PROGRAM 

Based on skill and concept needs identified in Step 11, state the 
objectives of the progrean. 

5* 55 STEP V ^ DETERMINE BASIC DESIGN FOR THE INSTRUCTIONAL COMPONENT OF 
THE REMEDIAL PROGRAM 

Indi cate the type of design that wi 1 1 be used for the 
instructional cotponent of the remedial program. (See Model Remedial 
Program Plans.) Specify teachers and other personnel to be involved/ size 
of groups and the amount of time for instruction. This information also is 
required for the completion of the claim form for reiitjbursement* 

5.56 STEP VI - IDENTIFY IHE DIAGNOSTIC PROCEDURES THAT WILL BE USED FOR 
THE PROGRAM 

Based on the content delineated in Step I, identify the tests and 
other diagnostic procedures that will be utilized to determine the specific 
needs of individual students. A plan for keeping records of students^ 
progress should be included. 

5.57 STEP VII - IDENTIFY PERSONNEL NEEDS 

Based on the instructional lesign, determine the personnel to be 
involved in the nrogram. Identify teachers and ancillary personnel. 

5.58 STEP VIII - DEVELOP IN-SERVICE COMPCWENT 

Identify in-service plans to update teachers, administrators and 
ancillary personnel involved in the remedial program. 

5.59 STEP IX - IDENTIFY INSTRUCTI(»IAL MATERIALS NEEDED 

Specify instructicxial materials that will be utilized in the 
program/ including computer software. Show how those materials reinforce 
and support existing instructional materials. 

5.510 STEP X - DEVELOP AN EVALUATION PLAN 

Utilizing the objectives stated in Step IV/ indicate how the 
program will be evaluated. While there can be various approaches by which 
to do thiS/ it is crucial that the approach adopted should measure the 
progress which the students attain on the objectives. One cot^nent of the 
evaluation plan will be the results of the retest of the Indiana Basic 
Competency Skills Test. 
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5.6 Sam^Y DISCUSSION 



This chapter provides an overview of remedial instruction models and 
their characteristics. It advances a diagnostic/prescriptive approach to 
tea<±ing the basic skills of reading, writing, and problem-solving. Whether 
we speak of remediation or regular classrocro instruction, the discussion 
cones down to this - good teadiing is good teaching and most often is 
characterized by the procedures described in this chapter. Whatever the 
setting, good teachinj calls for the best that is in us — the systematic 
application of our energy,, intellect, and resources for the greater good of 
students in our charge. 

For additional information on the characteristics of effective 
instructional/remedial programs, refer to Appendix D. 
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CHAPTER VI 



Developnent of the Carpetency Test 



6.1 ElATIONALE FOR TEST 

6.11 H.E.A 1202 

During its regular session of 1984, the Indiana General Assentoly 
passed House Enrolled Act 1202. The Act called upon local school 
corporations to inpleroent a program of remediation for students who fail to 
master basic carpetency skills and provides funds to conduct ranedial 
programs. The State Board of Education was given the task of prescribing a 
uniform test to assess conpetence, select grade levels to be tested and 
establish guidelines and funding levels for remedial programs. Also, the 
Act specified procedures for selecting students into the reroediai program as 
well as claiming and using remediation funds. 

H.E.A. 1202 served as the foundation for constructing and 
iitplesnenting the test. The text of the Act is presented in i^pendix E. 

6.12 STATE BOARD OF EDUCATION SPECIFICATIONS 

On March 14, 1984, tiie Indiana Commission on General Education 
(now the State Board of Education) adopted a policy on competency testing, 
which designated general content areas to be covered by a uniform test: 

a) the content of the test will reflect results of the National 
Assessment of Educational Progress. NAEP found that students tend 
to lade critical thinking skills in mathematics problem-solving, 
inferential reading catprehension and writing, particularly 
persuasive writing. 

b) the content of the test will reflect a limited domain of learning 
in exit-type basic skills. The interpretation of the term 
"basic skills" included higher-order, critical thinking skills. 

6.13 FIEEJD INPUT OH TEST CONTENT 

Prior to constructing the test, the Department of Education 
formed the IBCoT Advisory Council, coiT^>osed of teachers, administrators and 
other specialists from public school corporations throughout the state. In 
a series of meetings? this council produced recommendations on features and 
content of the test and reviewed the test at various stages of its 
development. 
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In scSdition, other groups of educators at the local level were 
assembled to provide input on types of skill areas and itans appropriate for 
the test. 

6.2 TEST CONSTRUCTION 

6.21 SELECTION OF CONTRACTOR TO CONffTRUCT TEST 

During the spring of 1984, the Department of Education 
disseminated a Request for Proposals to interested bidders, for development 
and iitplementation of a test and related scoring services. Appendix C of 
the RFP outlined the range of content to be measured and specified the 
desired psychometnic features of the test. These specifications are 
provided in Appendix F of this manual. 

CTB/McGraw-Hill, a nationally known test publisher, was awarded 
the initial contract for test development and implementation. 
CTB/McGraw-Hill will provide test instruments and scoring services for the 
state testing program. 

Throughout the test construction period, successive drafts of the 
test were submitted by the contractor to the Department of Education for 
approval of content and design. The Department, in turn, presented these 
drafts to the statewide Advisory Council for review and suggestions on 
changes to enable the test to most effectively meet state specifications. 

6.22 FINAL APPROVAL OF TEST FOR TRYOUT 

The final draft of the test Instrument which had been developed by 
the contractor was reviewed by the D^artment of Education and Advisory 
Council. Upon approval of tJie test instrument by the State Board, the test 
was subjected to tryout in several selected Indiana school corporations. 

6.3 TRYOUT OF GRADE 3 TEST 

6.31 TRYOUT SAMPLE: READING AND MATOEMATICS SUBTESTS 

During the fall of 1984, the third grade reading and mathematics 
subtests were administered to a sample of 3,943 third and fourth grade 
students in twenty-two Indiana school corporations. Third and fourth grade 
students were included in the sanple in order to estimate mid-year 
performance data, since the tests were piloted near the beginning of the 
school year. School corporations were selected in order to obtain a saitple 
of students representative of both Indiana and the national sample on which 
test items were calibrated by the contractor. Table 6-1 provides a 
breakdown of the sanple, while Appendix G lists corporations which 
participated in the tryout. 
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Insert Table 6-1 
About Here 



6*32 TRYOOT SAMPLE: WRITING TEST 

Diiring the spring of 1985, the third grade writing test was 
administered to 3,967 third grade students in sixteen corporations. A 
breakdown of this sanple appears in Table 6-2 and participating corporations 
are listed in Appendix G. 



Insert Table 6-2 
About Here 



6.33 TRYOUT PROCEDURES 

Tryout of the tiiird grade reading and mathematics subtests 
occurred on November 5 and 6, 1984. Tryout of the writing subtests was 
conducted on April 16, 1985. All subtests were administered to students in 
their classrooms by their regular teachers. 

During the testing sessions, teachers completed two surveys 
regarding students and their own reactions to the test instruments. One 
survey (Attendance/Timing Survey) called for Information regarding length of 
time required to complete each section of th3 test, along with students' 
test-taking behaviors. The other survey (Teacher Reaction Survey) obtained 
information on teachers' opinions about the format and content of the test. 
Responses to these surveys were analyzed with the tryout data and used to 
recoran^end additional modifications to the test instrument. 

6.34 THIRD GRADE TRYOUT RESULTS 

Data obtained from the tryout were used to analyze the technical 
characteristics of the reading and mathematics subtests • These 
characteristics are summarized in Table 6-3. Also, an item analysis was 
performed to determine average item difficulty levels • Results of the item 
analysis are shown in Table 6-4. 
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Insert Table 6-3 
About Here 



Insert Table 6-4 
About Here 



Generally, the tests exhibited the psychometric characteristics 
specified by the State Board of Education, However, two performance 
objectives, {"classifying" on the Reading Conprehension test, "division" on 
Mathematics Cottpitation test) did not yield satisfactory results* On 
recommendation of the Advisory Council, the State Board of Education decided 
to delete these objectives from the test. 

Analysis of responses on the third grade writing subtests are 
underway and are expected to be completed by early suitiner, 1985. After 
results have been reviewed by the State Board of Education, they will be 
presented in an updated edition of this chapter. 

6.4 TRYOOT OF GRADE 6 TEST 

6.41 SIXTH GRADE TRYOUT SAMPLE 

During the spring of 1985, the sixth grade reading, roathematics 
and writing subtests were administered to a san5)le of 3,993 students in 
sixteen school corporations* Characteristics of the sainple are presented in 
Table 6-5. Participants in the tryout are listed in Appendix G. 



Insert Table 6-5 
About Here 



6.42 TRYOUT PROCEDURES 

Tryout of the sixth grade reading and mathematics test instruments 
were conducted on March 5 and 6, 1985. Tryout of the sixth grade writing 
test instruments occurred on April 16, 1985. Tryout procedures, including 
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administration of the Attendance/Timing and Teacher Reaction surveys, were 
the same as those utilized in the third grade tryouts* 

6.43 SIXra GRADE TEST TRYOUT RESULTS 

At the time of this writing, analysis of the sixth grade tryout 
data is underway. Results of the analysis, expected to be cornpleted in 
mid-1985, will be described in an updated edition of this manual. 

6.5 FINAL APPROVAL OF TEST 

6.51 FINAL APPROVAL OF THIRD GRADE READING AND MAIHEMATICS TEST 

After considering the results of the Fall, 1984 tryout, along with 
reconmendations by the Departinent of Education, the State Advisory Council 
and the contractor, the State Board of Education approved the final form of 
the third grade reading and mathematics subtests* The State Board will 
periodically review, revise and approve subsequoit versions of these 
subtests throughout the duration of the testing and remediation program* 

6.52 FINAL APPROVAL OF THIRD GRADE WRITING AND SIXTO GRADE TEST 
INSTRUMENTS 

As analyses of other test tryout results are conpleted in 1985, 
the State Board will review those results and approve final forms of thfjse 
test instruments. 

6*53 SELECTION OF ADDITIONAL GRADE LEVELS TO BE TESTED 

To date, students in Grade Three and Grade Six have been selected 
as participants in the testing and remediation program. In 1985, the State 
Board of Education will select one additional grade level for program 
participation. After this additional grade level has been selected, an 
appropriate conpetency test instrument will be constructed and subjected to 
tryout during the spring of 1986. 
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CHAPTER VII 



Description of the Grade Three Test 



7.1 TEST STRUCTURE 

7.11 SUBTEST 

The Indiana Basic Corpetency Skills Test contains six subtests 
measuring the following skill areas: a) Reading Vocabulary; b) Reading 
Comprehension; c) Matheniatics Confutation; d) Mathematics Concepts and 
i^lications; e) Writing Mechanics; and f) Writing Sample. Each subtest is 
designed to be administered in separate testing sessions. These sessions 
are described in Chapter 2, "Administering the Test." 

7.12 SUBSKILL AREAS 

Each subtest measures students' performance on a number of 
subskills/ identified carponents of the major skill areas tapped by the 
subtests. In turn, each^subskill is measured by five items^ selected to 
provide representative exemplars of the subskill's domain. 




7.12 DIAGRAM OF TEST STRUCTURE 



The overall structure of the I 2ST and the various subtests may be 
conceptualized using the model shown in Figure 7-1. 



Insert Figure 7-1 
About Here 



7.2 READING VOCABULARY SUBTEST 
7.21 OVERVIEW 

The Reading Vocabulary Subtest measures students' skills in 
understanding the meanings of cannon vocabulary words. Vocabulary skills 
are considered critical to effective reading con5)rehension and are 
conceptually similar to other comprehension skills. However/ vocabulary is 
included in a s^arate subtest because these subskills are measured with 
conceptually different types of items. 
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The Reading Vcxrabulary subtest Includes three subskills: a) 
Identifying Synonyms; b) Identifying Multiple Meanings; and c) Using Context 
Clues. Each subskill is measured by five items, for a total of 15 items on 
the subtest. 

In contrast to items measuring other reading conprehension 
subskills / Reading Vocabulary items are unique in two significant ways. 
First/ the items are self-contained , meaning that they may be answeted 
without reference to separate reading passages. Second/ instructions for 
completing the items are not included in the test booklet* Instead, 
instructions are provided verbally by the teacher / who reads them directly 
from the TEACHER'S MANUAL. Thus, it is important that the teacher read the 
Vocabulary subtest instructions to students PRECISELY as they appear in the 
TEACHER'S MANUAL, to insure that all students uniformly understand their 
task. 

7.22 IDENTIFYING SYNONYMS 

This subskill involves the identification of words with similar 
meanings. Each item presents a stimulus word in a two--word prompt. The 
student selects one of four word choices which is similar in meaning to the 
stimulus word. 

SAMPLE ITEM: TINY ball 

0 young 0 small 0 big 0 fast 

7.23 IDENTIFYING MULTIPLE MEANINGS 

This subskill involves the identification of a word having two 
different meanings. Each item presents the student with two phrases, and 
asks him to select one of four words which best fits both meanings. 

SAMPLE ITEM: A SEASON OF THE YEAR and A PLACE WHERE WATER COMES OUT 

OF THE GROUND 

0 fall 0 well 0 spring 0 river 

7.24 USING CONTEXT CLUES 

This subskill requires utilizing the context in which a word 
appears to determine its intended meaning. Each item presents a stimulus 
word in a pronpt of two or three sentences. The student selects one of four 
word choices which has a meaning similar to the stimulus word, given the 
stimulus word's meaning in the context of the prompt. 

SAMPLE ITEM: We saw a CAMELOPARD at the zoo. It had a very long 

neck, long legs and spots. 

0 camel 0 leopard 0 zebra 0 giraffe 
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7.3 READING (X)MPREHENSION SUBTEST 
7.31 OVERVIEW 



The Reading Cuiprehension subtest measures basic literal and 
inferential cxiiprebension subskills utilized in silent reading tasks. Also, 
the subtest taps selected subskills associated with critical 
reading/thinking conprehension. 



7.32 LITERAL COMPREHENSION SUBSKILLS 



Literal coirprehensicxi refers to subskills in identifying and 
understanding ideas and their relationships which are explicitly stated in 
a reading passage. This skill area includes five subskills: a) Identifying 
Main Ideas; b) Identifying Cotrparisons and Contrasts; c) Identifying Cause 
and Effect Relationships; d) Identifying Passage Details; and e) Identifying 
Sequences. Each subskill is measured by five items. All items are passage 
dependent, meaning that the student xmst refer to particular passages in the 
subtest for information needed to carplete the items. 



7.321 IDENTIFZING MAIN IDEAS 



This subskill involves identifying the stated main idea or 
central theme of a passage. The student reads a brief story which 
narrates a series of events involving one or more characters. 
Following the story, an item calls for the student to select one 
of four statements which best describes the story's main idea. 

Bill went to the zoo. He laughed at the funny monkeys in 
their cage. He was afraid when the lion roared. A friendly 
zookeeper showed him many birds and fish. Bill thought all 
the birds and the fish were pretty. 

Bill saw many animals. He wanted to come back to the zoo 
soon. 



SAMPLE ITEM: What is this story mostly about? 



0 laughing at the monkeys 

0 a friendly zookeeper 

0 a trip to the zoo 

0 being afraid when the lion roared 



7.322 IDENTIFYING COMPARISONS AND CONTRASTS 



This subskill requires the student to determine the ways in 
which people or events in a story are alike or different, when 
these likenesses or differences are stated. Each item presaits a 
prompt asking the student to indicate how two characters or events 
in a given story are alike or different. The student selects one 
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of four statenenlis which correctly describes the similarity or 
difference between the characters or events. 



SAMPER ITEM: (Refer to the story in 7.321) 

In this stoxYf how were the birds and fish alike? 



0 they were funny 
0 they roared 
0 they were beautiful 
0 they belonged to Bill 

7.323 IDENTIFYING CkUSE AM) EEPBCT REEATIONSttlPS 



This subskill involves establishing causaL relationships^ 
betweei events described in a passage^ Each item contains a 
prompt presenting an event described in a given story* Using the 
information stated in the story, the stixtent selects one of four 
stateromts which best describes the cause of the evwit 
(or conversely, the effect of the event) . 



SAMPLE ITEM: (Refer to story in 7.321) 



What made Bill afraid? 



0 he saw many animals 

0 he saw funny monkeys 

0 the lion roared 

0 the zookeeper shG^^ him birds 



7.324 IDENTIFYING PASSAGE DETAILS 



This subskill requires that the student identify details 
associated with people or events which are stated in. a passage. 
Each item presents a proitpt asking the studoit to idaitify a 
detail contained in a given story. The student selects one of 
four statements which correctly states the detail. 

Susan wore a red dress to school. Her shoes were black and 
her coat was brown. When she saw Jane at school, she laughed 
because Jane was wearing a red dress too. 



SAMPLE ITEM: What color was Susan *s coat? 



0 red 

0 brown 

0 white 

0 black 
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7.325 IDENTIFYING SEQUENCES 



Thi s subsk ill i nvol ves iden ti f y i ng the crder of events 
described in a passage. The student reads a story which narrates 
a series of events. Following the story, an itea asks the student 
to indicate the order in which one of the events occurred. The 
student selects one of four statements which correctly states the 
order in which the event occurred. 

First, Jan makes her bed. Next she takes a bath and gets 
dressed. After breakfast, she goes to school. 



7.33 INFERENTIAL CX)MPREHENSION SUBSKILLS 

Inferential comprehension refers to subskills associated with 
cort5>rehOTding information which is not explicitly stated in a passage, but 
can be reasonably inferred from information which is stated. On the third 
grade test, this skill area includes three subskills: a) Predicting 
Outcomes; b) Identifying Inferred Cornparisons and Contrasts; and c) 
Identifying Character Traits. Five itans measure each subskill. 



7.331 PREDICTING OUTCOMES 

This subskill involves inferring future events or outcomes 
which might occur in a story, based on information provided in the 
story. The student reads a short story narrating events involving 
one or more central characters. After reading the story, the 
student is asked to predict what the central character (s) would do 
next, assuming the story were to be continued. The student 
selects one of four statements which best describes what the 
character (s) would do, given the information stated in the story. 

Lisa made sure she had her sneakers. She also put her shorts 
and socks into hex bag. Finally, she put a can of 
yellow balls into the bag. 



SAMPLE ITEM: What does Jan do before she takes a bath? 



0 
0 
0 
0 



eats breakfast 
gets dressed 
goes to school 
makes her bed 




SAMPLE ITEM: What is Lisa probably going to do? 



0 
0 
0 
0 



wash her clothes 
go swimming 
play tennis 
play volleyball 
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7.332 



IDENTIFYING INFERRED COMPARISONS AND CONTRASTS 



This subskill is similar to that described under the Literal 
CorprehensicMi skill area, in that students are seked to identify 
similarities and differences between characters or events in a 
passage. However/ as an inferential subskill/ conparison and 
contrast refers to the identification of IMPLIED similarities and 
differences among people or events/ based on their characteristics 
described in the passage. Items call for the student to draw 
ccnmon or distinguishing features between two characters/events in 
a given story/ using the information provided about them in the 
story. 

Sarah and Julie were walking home from school. They both had 
their reading and spelling bodes. Sarah had a Michael 
Jackson sticker on her notebook. Julie had Jedi stickers on 
her notebook. Sarah said/ "I am going swimming." Julie 
replied/ "I am going to a movie tomorrow." 

SAMPLE ITEM: In this story/ how are Sarah and Julie alike? 



0 they both like sports 

0 they both like Michael Jackson 

0 they both do homework 

0 they both like movies 

7.333 INFERRING CHARACTER TRAITS 



This subskill involves inferring a character's attitudes/ 
emotions or personal traits from information stated about the 
character in a passage. The student reads a story which provides 
descriptive information about a central character. After reading 
the story/ the item asks the student to indicate a trait of the 
character which is not stated in the story. The student selects 
one of four statements which best describes the character's trait/ 
given the stated information about that character. 

Andrea saw a small bird. It was running through the grass. 
Andrea saw that the bird was hurt. She caught the bird in 
her handkerchief. She took the bird to an animal doctor. 
The doctor said the bird would be well again soon. He told 
Andrea that she had done something very kind. 

SAMPLE ITEM: How did Andrea probably feel when the doctor told her the 
bird would get well? 



0 happy 

0 sad 

0 angry 

0 afraid 
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7.34 CRITICAL READING/IHINKING COMPREHENSION 



The critical reading/thinking portion of the subtest rosasures 
selected subskills in evaluating information presented in reading p^sssages* 
These subskills may be considered higher -order aspects of corprehension. 

This portion of the subtest includes two subskills: a) 
Distinguishing Reality from Fantasy; and b) Distinguishing Fact from 
Opinion. Each subskill is measured by five items. 

7.341 DISTINGUISHING REALITY FROM FANTASY 

This subskill involves determining if given events are real 
or unreal. Each itan presents four statements. The student 
selects the one statement describing an event that is unreal or 
could not actually occur. 

Instructions for conpleting the five itans measuring this 
subskill are not printed in the test booklet. Instructions are 
provided verbally by the teacher, who reads them directly from the 
TEACHER'S MANUAL. As is the case when reading instructions for 
the Reading Vocabulary Subtest, it is inportant that these 
instructions be read exactly as they appear in the manual. 

SAMPLE ITEM: 0 John walked to school 

0 He could not open the school's door 

0 The door laughed at John 

0 Someone came to open the door 

7.342 DISTINGUISHING FACT FROM OPINION 

This subskill refers to judgments as to whether information 
in a passage is factual or an opinion of the author. Each itan 
presents four statements related to a given story. The student 
selects the statement which describes information presented as a 
fact in the story. 

Carol ate cereal for breakfast. She put milk and berries on 
the cereal. She tried to make toast but the bread burned in 
the new toaster. Carol ate two bowls of cereal. She liked 
her breakfast very much. 

SAMPLE ITEM: In this story^ which sentence is true? 

0 Carol ate cereal 

0 Carol does not like cereal 

0 The toaster was old 

0 Carol was not hungry 
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7.4 MAiraiATICS COMmTATION SUBTEST 



7.41 OVERVIEW 

The Mathematics Cornputation subtest measures students ' skills in 
using basic addition, subtraction and multiplication facts to perform these 
operations. The subtest contains 15 itens measuring three subskills: a) 
addition; b) subtraction; and c) multiplication. Items are presented in 
vertical and horizontal (number sentence) forms. 

7.42 ADDITION 

This subskill involves addition of one-, two-, and three-digit 
nuntoers with suras ranging from less than 100 to greater than 1000. Sane 
ct)erations require regrouping. Each item presents a stimulus operation and 
five answer choices. The student selects the correct answer to the 
operation or indicates that the correct answer is not among the choices. 

SAMPLE ITEMS: 25 0 51 

+26 0 61 

0 41 

0 66 

0 none of these 



13 + 18 = 0 21 

0 32 
0 31 
0 25 

0 none of these 



7.43 SUBTRACTION 

This subskill concerns subtraction of one-, two-, and three-digir 
numbers and use of selected subtraction facts (e.g., regrouping, sufatracidon 
of zero from a number) in performing operations. Eadn iten presoiTis a 
stimulus operation and five answer choices. The student selecTis the correct 
answers to the operation or indicates that the correct answer is not 
provided among the choices. 

SAMPLE ITEMS: 83 - 2 = 0 85 

0 81 
0 73 
0 63 

0 none of i±ese 
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417 
-204 



0 213 
0 221 
0 413 
0 621 

0 none of these 



7.44 MULTIPLIO^TION 

This subskill involves use of multiplication facts to perform 
operations. These operations include: a) tables through 9 x 10; b) 
multiplication by zero and one; and c) multiplication of two-digit 
multiplicands by one-digit multipliers, with products less than 100. Each 
itero presents a stimulus' operation and five answer choices. The student 
selects the correct answer or indicates that the correct answer is not among 
the choices. 



SAMPLE ITEM: 



a) 8 X 4 



0 12 
0 30 
0 36 
0 4 

0 none of these 



b) 2 
xlO 



0 12 
0 20 
0 10 
0 17 

0 none of these 



c) 1 X 75 = 



0 76 
0 74 
0 81 
0 75 

0 none of these 



7.5 MATHEMATICS CONCEPTS AND APPLICATIONS SUBTEST 
7.51 OVERVIEW 

The Concepts and Applications subtest measures skills in 
conceptualizing basic mathematical relationships and_ applying these 
relationships to solve problems. The subtest includes five subskills: a) 
numbers and numeration; b) gecmetry; c) measurement; d) number sentences; 
and e) graphs and charts. On each subskill, three items measure 
understanding of the concepts while two items measure application of the 
concept to solving problans. Thus, each subskill is tapped by five items, 
for a total of 25 items. 
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7.52 NUMBERS AND NUMERATION 

This subskill pertains to unaerstanding basic rules of the 
numeration system. This includes: a) relating ncwbers in written and 
numeral forms; b) ordering numbers by magnitude; c) renaming numbers; and d) 
identifying place values of two-, three-, and four-digit nunbers. 

Concept items ask the student to identify particular numbers which 
satisfy given nurttoer/numeration conc^ts. ^jplication iteras present 
problems involving renaming or identifying place values of numbers. For 
each type of item, the student selects the correct answer from four or five 
choices. 

SAMPLE ITEMS: (Concept) 

Which numeral has a 2 in the tens place? 

0 245 
0 372 
0 126 
0 292 

0 none of these 

(Application) 

Jane had two thousand, six hundred and 
fifty-seven stamps. How many stamps 
did she have? 

0 2000 
0 2675 
0 2650 
0 2657 

0 none of these 

7.53 GEOMETRY 

This subskill refers to understanding basic geometric concepts and 
relating concepts to objects in the physical world. This subskill includes: 
a) identifying and distinguishing among various geometric shapes (e.g., 
triangles, squares, multi-sided figures, three dimensional shapes) ; b) 
identifying right angles; c) identifying parts of circles; and d) 
identifying objects which exemplify various geannetric shapes. 

Concept items ask the student to identify drawings which correctly 
d^ict given geometric concepts. Application items ask the student to 
identify drawings of objects which exemplify given concepts. For both types 
of items, the student selects the correct answer from four or five choices. 
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SAMPLE ITEMS: (Concept) 

V'Jhich figure is a cube? 



D 





(Application) 

Which of these is most like a sphere? 



□ <& n 





°6 



7-54 MEASUREMENT 

This subskill refers to understanding and applying common systems 
of measurement. This subskill includes: a) identifying units and intervals 
of length, distance, volume, time and money; b) ordering and comparing 
measurement units by magnitude; c) renaming measuronent units; and d) 
performing operations (i.e., addition, subtraction) to ccnibine and break 
down amounts within measurement scales. 

Concept items ask the student to identify particular units or 
intervals associated with given measurement systems. implication items 
present problems requiring the use of given measurement systems. For each 
type of item, the student selects the correct answer from four or five 
choices. 



SAMPLE ITEMS: (Concept) 

Which length is longest? 



0 one foot 

0 one inch 

0 one yard 

0 two feet 



(Application) 

Jim had two quarters, two dimes and one 
nickel. How much money did he have? 



0 75 cents 

0 74 cents 

0 80 cents 

0 53 cents 

0 none of these 



7,55 NUMBER SENTENCES 



This subskill pertains to understanding relationships among 
variables in number sentences. It includes: a) using basic arithmetic 
facts to solve number sentences involving addition^ subtraction and 
multiplication; b) using information provided in story problems to construct 
number seitences appropriate for solving the problems; and c) solving number 
sentences involving inverse operations (e^g^f addition and subtraction). 

Concept items present open number sentences and ask the student to 
identify numbers which correctly cocrplete the sentences* Application items 
present problems and ask the student to identify numbers or number 
sentences which are appropriate for solving the problems. For each type of 
item, the student selects the correct answer from four or five choices. 



SAMPLE ITEMS: (Concept) 

What number goes in the box to make this 
number sentence true? 

□ -.2 = 4 



0 3 

0 1 

0 2 

0 4 



(Application) 

Tamrny had five balls. She gave three balls 
to Jane. Whiqh number sentence shows how to 
find out how many balls Tamnty had left? 



0 5 - 2 = 

0 3 - 2 = 

0 5 - 3 = 

0 5 + 3 = 



7.56 GRAPHS AND CHARTS 



This subskill involves understanding the structure and 
interpretation of various types of graphs and charts. This subskill 
includes: a) interpreting information contained in picture graphs, bar 
graphs, and pie charts; b) corrparing entries in graphs and charts; and c) 
using graphed/charted information to solve problems. 

All items refer students to various graphs and charts in the test 
booklet. Concept items ask the student to identify particular itons of 
information contained in a chart/graph. Application items present a problem 



56 

52 



and ask the student to identify the correct ansv?er, using information in 
given charts/graphs. For both types of itens, the student selects the 
correct answer (or indicates that the correct answer is not given) from four 
or five choices. 



1 2 3 4 5 



John 












Jean 


■1 










Carol 










Patricia 




















David 




■ 









SAMPLE ITEM: (Concepts) 

How many balls does Patricia have? 

0 5 

0 4 

0 2 

0 3 

0 none of these 

(Applications) 

How many more balls does John have 
than David? 

0 4 

0 1 

0 3 

0 2 



7.6 WRITING MECHANICS TEST 

7.61 OVERVIEW 

The writing mechanics subtest will measure student's skills in 
spelling, capitalization, punctuation and graititiar. Each of these subskills 
will be measured by eight items for a total of thirty-two items. A multiple 
choice format is used throughout. Directions for completing the test are 
included in the TEACHER'S MANUAL and must be read to the students. 

7.62 SPELLING 

This subskill involves the recognition of correctly spelled words. 
This includes: a) words with long and short vowels and vowel combinations; 

b) consonant blends (e.g./ bl, dr, etc.) and digraphs (e.g., ch, ck, etc.); 

c) vowel controllers (e.g., r in fir, silent e, etc), digraphs (e.g., ay, 
ea, etc.) and diphthongs (e.g., oi, oy, etc.). Each item presents a 
stimulus sentence with a blank which must be completed with a correctly 
spelled word. The student selects one of the four choices which indicates 
the correct spelling of the missing word. 




SAMPLE ITEM: 



Johnny gave the money 

0 you 
0 yue 
0 yoi 
0 yu 

7.63 CAPITALIZATION 

This subskill involves capitalization of appropriate worcJs in a 
sentence. The subskill includes capitalizing: a) the first word of a 
sOTtence; b) proper nouns / names and formal titles; c) titles of books land 
stories; 3) days of the week; and e) months. 

SAMPLE ITEM: 

mary went/to the beach/ on yesterday. none 
0 0 0 0 

7.64 PUNCTUATION 

This subskill involves identifying the correct use of simple 
punctuation marks. Given a stimulus sentence, the student selects the 
correct punctuation from four choices or if none is needed/ marks "none." 

SAMPLE ITEM: 

Mary's birthday is tomorrow 

0 • 0 / 0 ? 0 1 0 none 

7.65 GRAMMAR 

This subskill tests the student's knowledge of the fundamental 
rules of standard English usage. This subskill requires the student to 
choose the correct: a) adjective or adverb modifier; b) subject/verb 
agreement; c) simple verb tense; d) degree of adjective corrparisons (i#e./ 
positive/ ccxnparative or superlative); and e) case of pronoun (i*e./ 
nominative/ objective or possessive). Each item contains a stimulus 
sentence and requires the student to select the correct word form from two 
to four possible choices. 

SAMPLE ITEM: 

Billy is the boy in our class. 

0 tall 
0 taller 
0 tallest 
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1.1 \^ITING SAMPLE SUBTEST 



7.71 OVERVIEW 

The purpose of the writing sainple subtest is to obtain a direct 
assessment of the student's writing skills by requiring the student to 
produce a writing senile. The writing sample will be scored by holistic and 
primary trait scoring methods yielding two scores per sanple. Holistic 
scoring is based upon the rater's overall impression of the effectiveness of 
a writing sample. Primary trait scoring/ on the other hand/ focuses on the 
writer's ability to blend the audience/ speaker role/ purpose and subject 
matter required by the writing task. Papers will be scored in conparison to 
example papers selected from Indiana's third grade writing tryout. A sample 
scoring guide can be found in Appendix B. Z^pendix H contains a more 
detailed description of these scoring methods. 

7.72 WRITING SAMPLE 

This subtest will measure students' skills in writing a response 
to a specific set of directions. This set of directions or "prompt" is 
intended to elicit a narrative or descriptive essay which is expressive in 
purpose and addressed to a specified familiar audience. To help students 
prepare for their writing task/ pre-writing activities will be prescribed in 
the TEACHER'S MANUAL. Students will be given thirty minutes to respond to 
the prompt. 

SAMPLE PROMPT: 

(Descriptive) 

Think about your favorite grown-up. Write a 
letter to your best friend describing that 
person and tell what makes that person special. 

SAMPLE PROMPT: (Narrative) 

Imagine that you wake up one morning and find that 
you have become your favorite animal. Write a story 
for the class telling about an adventure you had when 
you were that animal. 
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Table 2-1 

Suggested Testing Schedule: Grade 3 




Day 


Session Test items 


Time 


1 


1 


Reading Vocabulary 1-20 
10 minute break 


25 min. 


1 


2 


Reading Comprehension 26-48 
10 minute break 


26 min. 


1 


3 


Rpadino Pnmnrph<=>n<;i on 4Q-.fi'^ 


26 min. 


2 


4 


Math Computations 1-20 
10 minute break 


18 min. 


2 


5 


Math Concepts/ 21-45 
Applications 

10 minute break 


26 min. 


3 


6 


Writing Mechanics 1-20 


20 min. 



10 minute break 



3 7 Writing Sample 1-2 20 min. 



*The writing test (Session 6 and 7) will be given for the first time in 

1986. 
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Table 2-2 
Suggested Testing Schedule: Grade 6 



Day Session Test Items Time 



1 


1 


Reading Vocabulary 


1-15 


15 min. 






10 minute break 






1 


2 


Reading Coonprehension 


16-52 


32 min. 






10 minute break 






1 


3 


Reading Cocrprehension 


53-76 


26 min. 


2 


4 


Math Cornputations 


1-15 


16 min. 






10 minute break 






2 


5 


Math Concepts/ 


16-55 


31 min. 






10 minute break 






3 


6 


Writing Mechanics 


1-20 


20 min. 






10 minute break 






3 


7 


Writing Sample 




30 min. 
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Table 3-1 
Sunmary of Score Reports 



Report 
Title 



Description 



Level of 
Report 



Individual Score Report 



Performance Analysis 
ReEX)rt (PAR) by Class 

PAR: School Surrmary 



PAR: District Sunmary 



Item Analysis Reports 



Frequency Distribution 
Funding Report 



Class Record List 



Student results by objectives, 
subtests and composite test 

Class results on objectives, 
subtests and composite test 

Average results (number correct) 
on objectives and subtests for 
school and classes within school 

Average results (number correct) 
on <±>jectives and subtests for 
corporation and schools v;ithin 
corporation 

Breakdown of item response 
patterns by classes, schools 
and corporation 

Statewide and corporation 
score distribution on composite 
test and subtest. Percentile 
ranks of scores and number of 
corporation students below 
state cutoff score 

Standard, nationally r-ormed 
scores on composite test and 
subtests by student. Average 
standard scores by class, school 
and corporation 



Student 



Student 
Class 

Class, 
School 



School, 
Corporation 



Class 
School, 
Corporation 

Corporation 
State 



Student, 
Class, 
School, 
Corporation 
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Cause and Effect- 
Li teral 



Conpar is on/Con t ras t 
Literal 



Character Analysis 



Ccmp-^rison/Contrast- 
Inferential 



Predicting 
OutcoTOS 



28 
32 
46 
63 
67 



38 
43 
57 
69 



30 
33 
51 
56 
68 

35 
37 
42 
50 
62 



39 
44 
48 
53 
58 

40 
47 
54 
60 
64 



.83 
.62 
.78 
.77 
.87 



.86 
.93 
.93 
.81 
.86 



.79 
.75 
.77 
.83 
.82 

.91 
.94 
.93 
.82 
.84 



.88 
.92 
.76 
.81 
.71 

.94 
.89 
.87 
.86 
.88 



.44 
.43 
.33 
.44 
.49 



.55 
.51 
.56 
.50 
.60 



.42 
.47 
.50 
.47 
.53 

.54 
.54 
.55 
.46 
.59 



.51 
.57 
.49 
.40 
.43 

.50 
.51 
.52 
.45 
.54 



83 



89 



Table 6-4 
(Continued) 



Objectives 



Item 



Difficulty 



Pt. Biserial 



Addition 



Subtraction 



Multiplication 



Numeration 



Geometry 



Measurement 



1 


.86 


.33 


2 


.83 


.37 


3 


• 84 


.40 


4 


• 79 


.39 


5 


• 79 


.41 


6 


.84 


.41 


7 


.84 


.36 


8 


• 60 


A A 

• 44 


9 


• 87 


. 


10 


.O / 




u 


.68 


.54 


12 


.69 


.48 


13 


.73 


• bU 


14 


.61 


.4o 


15 


• 56 


A A 

.44 


21 


.91 


• 39 


22 


.85 


.39 


23 


• 85 


.35 


24 


.81 


.3/ 


25 


.92 


.J/ 


26 




.4/ 


27 


.88 


.41 


28 


.75 


.37 


29 


.84 


.42 


30 


.89 


.39 


31 


.90 


.38 


32 


.92 


.32 


33 


.93 


.39 


34 


.88 


.35 


35 


.79 


.39 



90 

84 



Table 6-4 
(continued) 



CSijective 



Item 



Difficulty 



Pt. Biserial 



Classifying c 



16 
17 
18 

19 
20 



.97 
.97 
.97 
.99 
.96 



.42 
.48 
.48 
.41 
.46 



Division d 



16 
17 

18 
19 
20 



.40 
.54 
.68 
.42 
.49 



.52 
.52 
.30 
.54 
.44 



a this item was revised on the final fonn of the test, to improve its 
discriminating power. 

b this item was revised on the final form of the test, to improve its 
discriminating power. 

c Because these items were judged too easy for most students in the 
sample, the objective "Classifying" and these items were deleted from 
the final form of the third grade test. 

d Because these items were judged too difficult for most students in the 
sample, the objective "Division" and these items were deleted fron the 
final form of the tests. 
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Table 6-5 

Breakdown of tryout sanple by e}±inic group meiribership 
and population center densityr sixth grade 
Reading r Mathematics and Writing subtests 



N Students Pet, Pet. 

Characteristic Sample Saniple Indiana * 



Total N 


3993 






White 


3477 


87.07 


87.31 


Black 


410 


10.27 


10.25 


Hispanic 


79 


1.98 


1.76 


Asian 


23 


.58 


.55 


Ainerican 








Indian 


4 


.10 


.13 


Metropolitan 


1126 


28.2 


34.0 


Suburban/Town 


1482 


37.1 


36.6 


Rural 


1385 


34.7 


29.4 



*Indicates percentages of all Indiana sixth grade students in each ethnic 
and population density category. 
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Indiana Department of Education 

I 

) Harold H. Ncglcy, Superintendent 

Room 829, State House • Indianapolis, IN 46204-2798 ♦ 317/232-6610 
Division of Research & Assessment • 317/927*0213 

SUGGESTIONS FOR ADMINISTERING THE INDIANA 
BASIC COMPETENCY SKILLS TEST 




In order for any achievement or competency test to provide a reasonably 
accurate picture of students' skills, known sources of testing error must 
be minimized. The Indiana Basic Skills Competency Test has been developed 
in a manner that enables accurate measurement of reading/ mathematics and 
writing skills with a minimum of measurement error resulting from the test 
itself. 

However, some sources of measurement error cannot be directly controlled 
through test construction and may significantly affect the accuracy of students' 
scores. Two of these sources can be generally categorized as: a) errors due to 
students' negative attitudes, emotional states or physical states when taking 
the test; and b) adverse conditions in the testing environment (e.g., the classroom). 

This document offers several suggestions to teachers and others responsible 
for test administration, on promoting effective conditions for giving the 
IBCST. Doubtlessly, many test administrators already will be familiar with 
these suggestions; however, it is hoped that they will provide a useful review. 

SUGGESTIONS FOR ATTITUDINAL AND EMOTIONAL PREPARATION OF STUDENTS 

To the degree that you can communicate to your students about the test 
in positive, enthusiastic terms, (both verbally and non-verbally) , they 
will more likely respond in kind. 

Inform students in advance that they will take the test and explain its 
purposes, when explaining the test, it is helpful to emphasize the benefits, 
rather than the evaluative aspects, of testing. Many students fear tests 
because they fear evaluation of their performance. Thus, if you promote 
their test-taking as a way to **help you help them" an attitude of cooperation 
may be enhanced. 

Students often need reassurance that they are not expected to know answers 
to all the questions on a test and can do well even if they find certain 
questions difficult. 



O 

gl^^ fflcc location: 3833 N. Meridian St., Indianapolis 

_ _._ _. . 94, 



4. Many students hinder the.lr test performance by ruminating on a few 
difficult questions at the expense of other questions they could more 
easily answer. Encourage students to thoughtfully attempt difficult 
questions, but spend no more than one minute on any question. 

5. Ensure that most students understand the instructions before beginning 
the test. If a few students do not understand a large portion of the 
instructions, it is likely that they are not listening effectively. Ask 
these students to clear all other thoughts and listen carefully as you 
read the instructions again, slowly. If a student still does not under- 
stand the task efter a second reading, then explain that portion of the 
instruction privately to that student in language you believe he or she 
will understand. Note, however, that it is usually more effective to 
calm an anxious student than to paraphrase instructions, since an anxious 
student will seldom understand paraphrased instructions better than 
standard instructions, 

6. Agitated behavior and frequent questioning of the teacher durir;g testing 
are usually signs that the student is anxious. Use your knowledge of 
these students to calm them and reassure that they need only give the 
answers they believe are best, based on their understanding of the 
questions. 

PROMOTING STUDENTS' PHYSICAL READINESS FOR TESTING 

1, If possible, avoid testing on Monday, Frida> or days immediately preceding 
or following vacations and special school events, 

2, Administer tests in thi2 morning before students have expended a great 
deal of their day's energy, 

3, To avoid fatigue-related decrements in test performance, space testing 
periods over two mornings (i,e,, reading tests on one morning, math 
tests on the following morning) , 

4, Avoid testing immediately after students have engaged in strenuous 
physical activity, 

5, It is well known that students tend to perfom better on tests when they 
are well rested and fed. Parents should be encouraged to ensure their 
children get a full nights sleep and eat breakfast prior to taking the 
test. When the latter is not possible, teachers may wish to arrange 

for their students to eat or drink something (e.g., piece of fruit, milk) 
in class before testing, 

PROMOTING AN EFFECTIVE TEST-TAKING ENVIRONMENT 

1, Become familiar with the test materials, particularly the instructions, 
prior to the test date. If you are familiar with the materials and 
have them organized for quick use, delays, a major source of tension/ 
disruption in the room will be minimized. 




2. There are several sources of distraction in classrooms which commonly 
interfere with testing activities. These distractors, along with 
methods for eliminating them, are described below: 

a) ringing telephones and end-of-period bells (disable all bells 
and buzzers audible in the testing room) . 

b) noise, visual activity in hallways and outdoor areas (close doors, 
windows and curtains; limit use of hallway outside testing room) . 

c) student movement during test to sharpen pencils, approach teacher, 
etc. (keep extra pencils on hand, go to students when they have 
questions) . 

3. Remove or cover materials in the rcom (e.g., wall hangings, maps, posters, 
globes, art objects) which might distract students attention or provide 
clues to correct answers on certain questions. 

4. Seat students far enough apart from one another to enhance privacy. Adequate 
spacing is the most effective method for discouraging copying. However, 

an equally important purpose is to give students a greater feeling of 
privacy, particularly useful for anxious children. 

ADDITIONAL SUGGESTIONS FOR THE IBCS WRITING TEST 

There are two sections on the writing test. One section contains objective 
questions, while the other section contains two prompts designed to elicit 
handwritten responses. The testing suggestions in this paper apply to both 
sections of the writing test. However, the tips described below are directed 
to the handwritten section and are derived from the experiences of other states 
using a similar type of test. 

1. It is critical that you do not provide any structuring of students' 
writing, beyond that given in the instruction. "Additional structuring" 
includes: 

a) providing students with a topic on which to write or recomiranding 
the content of their responses to the prompts. 

b) providing students with standard opening/closing sentences. 

c) providing an outline for the form of the responses. 

d) any other structuring which causes students to alter the content 
or form they might have used on their own. 

Each of these structuring techniques has been found tc consistently 
and substantially lower students* performance. 

2. Reassure students that they are expected only to write a response 
than answers the questions communicated by the prcrpt, that th^re are 
no right or wrong answers and that they need only do their best to 
help you help them. 
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Sample Indiana Primary Trait Scoring Guide 



Descriptive Paper 
Grade 3 

4 This paper has an interesting topic or "beginning" sentence. The 
writer uses descriptive words and f^irases. Word choices are frequently 
imaginative. The writer attempts to be expressive, to bring to life a 
memory, an experience, or an impression. Ideas are presented in a 
sequential way; there is a definite seise of continuity. There is a 
clear sense that the writer addresses audiencx^ in an appropriate way. 

3 This paper has an interesting topic or "beginning" sentence, bur it is 
not as unified or well-organized as a 4 paper. Tlie writei: attempts to 
use descriptive words and phrases, but they are not as creative or 
imaginative as those found in a 4 paper. There is a clear sense that 
the writer addresses the audience in an appropriate way. 

2 This paper has a confused or undirected focus. Word choices are weak 
or imprecise. There is little, if any, sense of continuity. A 2 paper 
is usually more like a skeletal listing of facts, events, and/or ideas, 
than a well-developed description^ There is little, if any, sense of 
audience. 

1 This paper cannot be followed. It may be too brief to be understoc;^. 
Random word choice and faulty sentence construction obscure the 
writer's intentions. There is no sense of audience. 

0 This will be a blank paper. 

A This will be a totally illegible paper. 

B This will be a paper which addresses a completely different topic. 



QUESTIONS RT/aAnDlNO WIS MEPORT 
SHOULD BE DIRECTED TO 3t7/t27*0Xt3 



DUE MAY It, 19ti 

hahold h. neqcey, super i ntenoent 

INDIANA DEPARmCNT OF EDUCATION 




CO^S>LETC THIS FORM. RETAIN A COPY FOR YOUR RECORDS AND RETUfVI THIS COPY TO DIVISION 
OF RESEARCH AND ASSESSMENT, ROOM 22>. STATE HOUSE, I ND I ANAPOU I S • INDIANA 4i204. 



COMPETENCY TESTING AND REMEDIATION CUAIM FORM FOR REHWURSEMCNT OF FUNDS 





SECTION 1 


IDENTIFICATION 




(t) 


SCHOOU CORPORATION 




SCHOOL CORP. NUMBER 


(3) 


CORPORATION ADDRESS 


(4} SCHOOL YEAR 


(S) COUNTY NUMBER 



SECTION II REUIBURSEMENT INFORMATION 


(1) 


ENTER NUMBER IN GRADE THREE WHO SCORED BELOW 






THE STATE STANDARD. (DO NOT INCLUDE STUDENTS 






WHO A.^ ELIGIBLE TO RECEIVE BASIC SKILLS 






INSTRUCTION FROM A SPECIAL EDUCATION TEACHER 






UNDER IC 20-1-C). 


(IJ 


(2) 


ENTER NUMBER FROM 1 ABOVE WHOM YOU PLAN TO 






REPLACE (FO^^ REASONS OF CLASSROOM PERFORMANCE 






AND TEACHER OBSERVATION - HEA 1202, CH 9 SECTION 






I, F) WITH OTHER STUDENTS. 


12) 


(3) 


ENTER NUMBER FROM 1 ABOVL' WHO WILL RECEIVE 






REMEFDtATlON IN SUNDER, I9t5. 


{31 


(4) 


ENTER NUMBER FROM 1 ABOVE WHO WILL PECEIVE 






RENV£D!ATlON IN FALL, 1965 BECAUSE 








(4) 


(5) 


ENTER TOTAL OF ( 3 ) AND (4). 


(5) 


l«) 


MULTIPLY THE TOTAL IN (5) BY $ , AND ENTER. 


(•) 


{7) 


SUGGESTED RECEIPT ACCOUNT 3199. 




(8) 


SU^^STED EXPEND] TURE ACCOUNT- -11100 AND 1 1900. 






OBJECT CODES 110-100. 





SECTION III AUTHORIZATION 

(1) THE UNDERSIGNED CERTIFIES THAT THIS REPORT IS TRUE AND ACCURATE, AND THAT 
FUNDS RECEIVED UNDER HEA 1202 WILL BE X^ED TO CARRY OUT THE INTENT OF 
LEGISLATION. 



(2) SUPERINTENDENT'S NAME 



{4) SUPERINTENDENT'S SIGNATURE 



(3) APPLICATION DATE 



(5) TELEPHONE NUMBER 



SECTION IV APPROVAL 



tl I STATE BOARD OF EDUCATION 



2) DATE 



ERIC 



(OVER) 



9g BEST COPY AVAILABLE95 



war tow V pwoonAM PttcmmoN 



TWIS SIDC or IMC CLAIM FOm IB DCVOTKO TO PIVOIMM DCSCItlPTION. ITS CSOMPIXTION 
SIQHMLS 1HC NATUMC OF RKMCDIATlON PLAINED WITH FUNDS PnOVIKD. 

(f) AMOUNT ANrriCIFATCD FNOM LINE f, KCTION 11 f 

(2) HOm MUCH OF LINK I WILL FAY PHOFCSS i ONAL TKAOmn SALARIKST 

(S) HOm MANT TEACHERS, IN FULL TIISC KQUIVALENCET 

(4) SUBTRACT LINE Z FROM LINE I. 

(5) WHAT WILL LlfC 4 PAY FORT FILL IN N/A IF NOT APPLICABLE. 

(•) HOW MANY TOTAL HOURS OF REMEDIATION ARE PLAIMCD FOR 

STUDENTS SELECTED? 

(7) IF PLAMCD FOR tHE SUMMER, HOW MANY WEEKS? 

HOW MANY DAYS PER WEEK? 

HOW MANY HOURS PER DAY? 

(•) IF PLANNED FOR FALL, HOW MANY WEEKS? 

HOW MANY DAYS PER WEEK? 

HOW MANY HOURS PER DAY? 



|») PLEASE INDICATE WHICH OF THE FOLLOWING PLANS WILL BE USED TO PROVIDE 
REMEDIATION. OR INDICATE IF OTHER PLANS ARE TO BE USED (REFER TO THE 
C0K«:TENCY testing and remediation program manual, CHAPTER V, FOR A 
DESCRIPTION OF THE PLANS BELOW). CHECK ALL THAT APPLY. 

PLAN I DESIGN A NEW REMEDIAL PROGRAM 



PLAN 2 COMBINE REMEDIATION PROGRAM WITH OTHER SPECIAL OR 
SUM4ER SCHOOL PROGRAMS 

PLAN 3 USE AVAILABLE READING, LANGUAGE ARTS AND MATHEMATICS 
SPECIALISTS 

PLAN 4 REMEDIATE WITHIN REGULAR CLASSROOM WI*IH REGULAR CLASSROOM 
TEACHER 

PLAN 4, USING TUTORS 

PLAN 4, USING AIDES OR VOLUNTEERS 

PLAN 5 USE COMPUTER- ASSISTED INSTRUCTION 

OTHER PLAN 



(10) IN THE SPACE BELOW, PLEASE PROVIDE A BRIEF NARRATIVE ON YOUR REMEDIATION 
PLAN, INCLUDE IN THIS NARRATIVE YOUR PLANS FOR SELECTING STUDENTS FOR 
REMEDIATION. 



BEST COPY AVAILABLE 
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Characteristics of Effective Instruction: 
Summary of Recent Research Findings 



Dr. Floyd F. Robison 
Division of Research and Assessment 
Department of Education 



The purpose of this brief report is to present a summary profile of 
an effective remedial instruction program, based on research findings con- 
cerning methods associated with increased student achievement. This profile 
is discussed in three areas: a) modes of instruction; b) characteristics 
of the instructional program; and c) characteristics of instructional 
materials. 

Mode s of instruction 

According to research findings reviewed by Benjamin Bloom and his 
associates (1984) tutoring constitutes the most effective mode of instruction 
for students who perform poorly under conventional classroom approaches. 
Tutoring involves one to three students learning a subject matter from 
one teacher. During the course of instruction, students are periodically 
tested to determine their progress toward specific learning objectives. 
Test results are used to provide feedback and corrective instruction. 
Following corrective instruction, students are retested to determine the 
degree which course objectives have been mastered. 

When tutoring is not feasible for economic or other reasons, mastery- 
based instruction in a classroom setting has also been found to promote 
substantial gains in achievement. Generally, the mastery mode of instruction 
is an extension of tutoring to larger groups of students working with 
one teacher. As with tutoring, students* progress toward well-defined 
learning objectives is regularly assessed for the purposes of feedback and 
additional instruction in areas of insufficient mastery. Following the 
additional instruction, students are retested to determine subsequent 
mastery level. This process of testing, feedback, remediation and 
^'etesting is repeated until most students have mastered each objective. 
In his review, Bloom (1984) concluded that gains in student learning 
are greatest when mastery instruction and tutoring are coml^ined in 
the same course. 

Characteristics of effective instruction 

The following characteristics have been associated with effective 
mastery-based instructional programs (For more extensive reviews of research 
related to these characteristics, see Black and Burns, 1976; Bloom, 
1984; Gagne and Briggs, 1979; Lysakowski and Walberg, 1981; Luiten, 
Ames and Ackerson, 1980):. 
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1. Pupil- teacher ratios are as low as feasible. While no optimal 
ratio has been established/ evidence gathered by Gene Glass 

. suggests that student time on task, quality of feedback and 
equal treatment of students by teachers, is enhanced as 
class size is reduced. 

2. The subject matter is broken down into a series of learning 
objectives, outcomes which can be concretely described and 
measured- Criterion levels of performance are established 
to determine mastery of each objective. 

3. Each student's level of competence in the subject matter, 
along with specific knowledge or skill deficiencies, is assessed 
at the outset of the course. Results of this initial assessment 
are used to select materials and plan an instructional 
strategy appropriate to students* needs and initial levels 

of competence. 

4. Initial class meetings are devoted to helping students learn 
any prerequisite knowledge and skills related to the subject 
matter in which they are found to be deficient on initial 
assessment. 

5. Instruction incorporates periodic evaluation and immediate 
feedback to students regarding their progress toward objeci-ives. 
During instructional sequences related to each objective, 
students are frequently tested to assess level of mastery. 

Test results are used to provide feedback and additional 
instruction in which mastery has not been achieved. Students 
are then retested. This process is repeated until all students 
have achieved criterion mastery level for the objective 
(or it is determined that particular students have reached 
the highest level of mastery they can achieve) . 

6. Testing is done for the primary purpose of assessing progress 
and diagnosing difficulties, rather than assigning formal 
grades. A formal course grade may be assigned at the end 

of the course to indicate mastery level of all objectives. 
While it may be appropriate to assign grades for performance 
on individual objectives, these grades are assessed after 
the final test for each objective. 

7. Positive student performance is consistently reinforced 

by the teacher and, when possible, through the instructional 
materials. 

8. Students are helped to apply the subject matter to situations 
and problems in everyday life. Applying concepts to life 
situations has been found to improve learning by making concepts 
more meaningful to students and promoting more positive attitudes 
toward the subject. 
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9. In addition to conveying the subject matter, instruction 
helps students learn and use problem-solving skills. 

10. Students are regularly aiven homework derived from course 
material related to each course objective. Effective 
homework allows practice with the course material, promotes 
development of problem-solving skills and serves as an 
additional means of providing feedback to students. Also, 
homework may be used to help students apply course materia^ 
to concrete situations in daily life (Paschal, Weinstein 
and Walberg, 1984) . 

11. Mutual support and helping among students in the class is 
encouraged. It has been observed that students can help 
one another loarn difficult material and increase positive 
learning attitudes. 

12. Direct parental involvement is promoted. Parents are frequently 
informed about what is being taught and their children's 
progress toward objectives. Parents are encouraged to 
participate in the instructional program through home tutoring, 
encouraging effective study habits and fostering positive 
attitudes about the subject and learning in general. 

Characteristics of effective instructional materials 

To date, no single type of instructional materials or media have 
been found to be most effective for promoting learning in a subject 
by all students. However, recent research has identified some general 
features of useful materials and their use in remedial instructional 
programs (For more extensive information related to these characteristics, 
see Bloom, 1984; Briggs, 1968; Gagne and Briggs, 1979): 

1. Selection of materials is based on specific needs of students 
in the class, determined through initial competency assessment 
(see point 3 above). Some students tend to respond better 

to particular types of materials (e.g., books, films, guest 
speakers, games, structured activities). As a general guide, 
students' attention and interest are best obtained when a 
variety of materials and media (e.g., visual, auditory, 
tactile) are used. 

2. Several writers have observed that less able students learn 
more readily when they are able to acquire direct experience 
with the subject matter {''learning by doing") via the 
instructional materials. For example, a remedial reading 
course might engage students in role-playing stories. 
Students in a remedial mathematics course might actually 
manipulate objects to practice basic arithmetic operations. 

3. F erials provide concrete examples of concepts to be mastered. 

4. P) .ted materials present a topic by beginning with an overview 
of new material to be learned, and its relationship to 
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previously learned material (David Ausubel refers to this 
overview as an "advanced organizer"). 

5. , Materials provide frequent opportunities for studen.ts tb 

assess their own progress and challenge their thinking, 
such as questions or structured exercises located throughout 
the material. 

6, The material periodically provides for reinforcement of students' 
progress. Co^nputerized learning programs are excellent 
examples of instructional materials with "built-in" reinforce- 
ments. Other ex2unples include teaching machines # games and 
similar types of equipment. 

In summary, an effective remedial instruction program may incorporate 
number of characteristics including the following: 

1. mastery-based instruction, coupled with tutoring when possible; 

2. lower pupil-teacher ratios? 

3. instruction and assessment linked to specific learning objectives; 

4. instruction which is structured, yet sufficiently flexible to 
allow appropriate paeing of students; 

5. initial assessment of students to diagnose weaknesses in 
prerequisite skills and determine initial competency levels; 

6. initial instruction in prerequisite knowledge and skills? 

7. regular, specific and immediate feedback; 

8. teaching students to use both subject-related and general 
problem solving skills; 

9. encouraging students to apply concepts to everyday life 
events and problems; 

10 • regular assignment of homework tasks allowing practice using 
the course material; 

11. establishing mutually supportive helping relationships among 
students; 

12. regular, consistent reinforcement of students* progress; 

13. use of a variety of instructional materials and materials 
which allow students to learn by doing; 
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14, use of materials which allow students to inonitor their 
progress and which reinforce positive performance; 



15. materials which provide overviews of material to be- learned 
and relate new material to previously learned material. 

References 

Block, J. Hw and Burns, R. (1976). Mastery learning. In L, S. 
Shulman (Ed,), Review of Research in Education {No.4) • Itasca, 
Illinois: Peacock Press, 

Bloom, B, S. (1984), The two-sigma problem: The search for methods 
of group instruction as effective as one to one tutoring. 
Educational Researcher , 38, 160-176. 

Dale, E.A. (1969), Audio-visual methods in teaching (3rd ed) , 
New York: Holt, Rinehart and Winston 

Gagne, R. Rm., and Briggs, L. J. (1979), Principles of instructional 
design (2nd ed) , New York: Kolt, Rinehart and Winston, 

Lysakowski, R. S,, and Walberg, H. J, (1981), Classroom reinforcement: 
A quantitative synthesis. Journal of Educational Research, 75, 
69-77. 




Luiten, J., Ames, W, , and Ackerson, G. (1980), A meta-analysis of the 
effects of advanced organizers on learning and retention. American 



Educational Research Journal , 17, 211-218, 

Paschal, R. , Weinstein, T. , and Walberg, H,J, (in press). Effects 
of homework: A quantitative analysis. Journal of Educational 
Research. 



104 




101 



Sfctmi ItegriT ■iiiim lOart Ommwl AmmMy 
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HOUSE ENROLLED ACT No. 1202 



AN ACT to amend the Indiana Code eonemaoff education. 

Be it enacted by the General Aeeemhly of the State of 
Indiana: 

SECTION 1. IC 21*3-9 it added to the Indiana Code at a 
NEW chapter to read ai followa: 
Chapter 9. Baaic Competency Skilla Taatinf and Remedia- 



Sec. L (a) The foveming body of a achool corporation 
ahaii develop and implement a program of basic competency 
akillfi remediation for atudenta who need remedial work in baaic 
competency skills. 

(b) The state board of education shall prescribe: 

(1) guidelines and criteria for remediation programs 
developed under this section; 

(2) the grade levels at which remediation is to be offered; 

(3) the uniform basic competency skills test and minimum 
acceptable test scores; 

(4) the grade levels at which basic competency skills tests 
are to be administered; and 

(5) a per pupil dollar amount for funding each type of 
testing and remediation program approved under this 
section. 

(c) The governing body of each achool corporation shall 
make an initial determination of the amount of the distribution 
to be made to that school corporation under this section by 
pertbrming the following computation: 

(1) Determine the total number of students in the achool 
corporation: 

(A) who are in the grades in which remediation is to be 
provided under this Mction; and 

(B) whose scores on the basic competency skills tests are 



tion. 





below the minimum acotpUUe motm prtecrib^d hy the 

•Ute board of education. 
(2) Determine the total number of itudenta in the a^^hool 
corporation: 

(A) who are in the tradoe in which remediation ia to be 
provided under thie taction; and 

(B) who are eligible to receive their basic akillt 
instruction from a apecial education teacher under 

IC 20-1-6. 

(?/) Sub^act the number determined under subdiviaioD (2) 
from the i>umbcr determined under aubdiviaioD (1). 
{4) Multiply the remainder obtained under av:bdiviaion (3) 
by the amount prescribed under subeection (bX5). 

(d) The governing body of aadi school corporation shall 
submit the results of ita computation under attbaection(c) to the 
state board of education. The state board of education ahall 
verify these computations before ftinds are distributed to the 
school corporation by the auditor of state. 

(e) The total amount of distributions to school corporations 
under this section may not exceed the amount appropriated by 
the general assembly for remediation and testing programs 
under this section. 

(f) A schoo] corporation shall: 

(1) participate in the basic competency skills testing 
program developed by the state board of education under 
subsection (b); 

(2) obtein approval of its remediation program f^m the 
state board of education; and 

(3) include in its remediation program a mechanism for 
selecting the studenta who will receive remediation under the 
program. 

The mechanism for selecting students who will receive 
remediation must use the results of the basic competency skills 
test but with the approval of the state board of sducation, may 
include other evaluation techniques such as classroom 
performance and teacher observation. The number of studenta 
selected shall not increase the distribution under this section. 

(g) School corporations shall use funds rsunved under this 
section only for the implementation of testing and remediation 
programs approved by the state board of education. 

(h) Before October 1 of each year, the superintendent of 
each school corporation that receives Ainds under this section 
shall certify that those funds have been used for the purposes 
provided in this section. This certification must be made in a 
written statement to the state bonrd of education. 
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(i) The rMulU of the tMu requirMl by this Mction shall be 
made available only: 

(1) to the student and the student's parent or guardian; or 

(2) when required for use for purposes of this section. 
Sec. 2. (a) In addition to the testing rtqoirementi of 

section 1 of this chapter* each school oorporr^tion shall conduct 
a testing program of at least four (4) gnde levels as part of a 
program of evaluation of each student's learning progress, 

(b) The scores of an individual student on tests required by 
this section shall be made availaUe only to that student and 
the parent or guardian of that student 

(c) The cumulative results o: tests rsquirsd by this section 
shall be compiled by each school oorporati<m in a manner that 
will permit evaluation of learning progres s within the school 
corporation. The school corporation ehall make the 
compilation of test results available for public inspection, and 
may issue an interpretation of the test results together with the 
compilation. 

SECTION 2. (a) The initial basic compeUncy skills 
testing under IC 21-3-9*1. as added by SECTION 1 of this act, 
shall be administered to students in grade level 3 before March 
1, 1965. Remediation programs for the students selected from 
that grade level shall be provided in a summer school program 
of at least four (4) weeks, which need not be consecutive, and 
shall be completed before the beginning of the fall semester of 
1985. However, the state board of education, upon request of a 
school corporation, may approve the substitution of an 
equivalent program of remediation that will be provided in that 
school corporation during the fall semester of 1985. 

(b) A student selected for the summer school remediation 
program shall be retested upon completion c^the program, and 
the school corporation shall then determine whether the 
student should advance to grade level 4 based on the following 
considerations: 

(1) TheresulUof thereUst 

(2) The student's attendance record in the program. 

(3) The recommendation of the student's teacher in the 
program. 

(4) The recommendation of the student's teacher in grade 
level 3. 

(c) This SECTION expires July 1, 1986. 

SECTION 3. (a) On or before April 15. 1985, the sUte 
board of education shall prescribe a total of two (2) grade levels 
for which testing and remediation under IC 21-3-9-1, as added 
by SECTION 1 of this act, shall be required. RemediaUon 
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required undtr this nbMction th^h btrtquirid in tach ichool 
corporation: 

(1) in the 1965^1966 achool ytar; or 

(2) in a attromtr icbool proffram in tht atimmtr of 1966, 
units* ptrmiation to aubttituta an aquivalant proffram of 
rtHHKliation durinf the fall atmaatar dT 1M6 ia requaatad by 
tht achool corporation and approvad by iha atatt board of 
aducation. 

(b) On or btfort January 1, 1M6, tht atatt board of 
aducation ahall prtacribt a total of thrat (3) fradt Itvtii for 
which tttting and rtmadiation undtr IC 21-S4^1. aa addad by 
SECTION 1 ofthitacl,ahaIIbtraqttirad.iUmadiationT^uirtd 
under this aubaaction ahall ba taquirad in aach adiool 
corporation: 

(1) in tht 1966-1M7 achool ytar; or 

(2) in a aummtr achool prcfram in tht aummtr of 1967, 
unleaa ptrmiation to aubatitutt an aquivaltnt procram of 
remediation durinf the fall atmtattr of 1967 ia raquaattd by 
the achool corporation and approved by tht atatt board of 
aducation; 

and in auccaedinc ytars. 

(c) Thii SECTION txpiret February 1,1986. 
SECTION 4. Btcauat an tmerrency exiatt, thia act takes 

effect upon passage. 



President of Senate 



Speaker of the House of Representatives 



Approved: 



Governor of the State of Indiana 
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DESIGN SPECIFICATIONS 



Basic Intent 

The intent of these specifications is to provide structure, yet enough 
flexibility, for prospective contractors (bidders) to propose an exemplary 
basic skills testing program. The Department of Public Instruction 
invites bidders to draw on their expertise, and experience, and wisdom 
in order to meet the intent of H»E.A. 1202? and at the same time, 
consider the needs of various users of the intended test information • 
Therefore, the Department wants each bidder to propose the level of 
specificity necessary to demonstrate both the rationale and effort 
needed to complete basic-skills testing over the next three years. 



The Indiana Statewide Basic Skills Competency Tests will tap a restricted 
domain in reading, mathematics, and writing for Grades 3, 6 and 8. Since 
the major purpose of the tests is to assist Indiana's educators with the 
implementation of remediation programs, it is vitally important for the 
tests to include items that reflect learning skills in school both prior 
to and during the designated grades. The Indiana State Board of Education 
has decided that the tests should include coverage of areas reported by 
the National Assessment of Educational Progress (NAEP) , which found that 
students lack skills in critical thinking, problem solving, and persuasive 



In reading, the tests should cover major reading comprehension skills 
that can be measured from the administration of reading passages and 
corresponding multiple-choice questions. In mathematics, the tests 
should cover computation , concepts , and problem solving skills that 
can be measured from multiple-choice test questions. The writing test 
should consist of actual writing exercises requiring each student to 
produce original writing samples; and also, measure the students' skills 
in usage of grammar, punctuation, capitalization, and spelling. 

Reading Grade 3. The basic skills reading competency test for Grade 3 
should contain passages and corresponding multiple-choice test questions 
that represent comprehension skills usually expected of students in grades 
one to three . The comprehension test will contain seventy (70) test 
questions (items), with fourteen (14) reading passages and five (5) items 
devoted to each passage. It is also expected that the test will cover the 
following major skill areas with designated subskills: 

1. Meaning vocabulary (15 items) 



Content 



writing. 



a. 



b. 



c. 



Context clues 

Multiple meanings 
Synonyms 



5 items 
5 items 
5 items 



2. 



Literal Comprehension (25 items) 



b. 



a. 



Main ideas 

Comparison and contrast 



5 items 
5 items 
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c. Cause, and effect 5 items 

d. Details 5 items 

e. Sequence — 5 items 

3, Inferential Comprehension (20 items) 

a. Classifying 5 items 

b. Predicting outcomes 5 items 

c. Comparison and contrast 5 items 

d. Character traits 5 items 

4, Critical reading/thinking (10 items) 

a. Reality vs. fantasy 5 items 

b. Fact vs, opinion 5 items 



Reading Grades 6^ and £• The basic competency reading tests for Grades 
6 and 8 should contain passages and corresponding multiple-choice 
test questions that represent comprehension skills usually expected of 
students in the designated grades . Each test will contain seventy-five 
(75) test questions (items) , with fifteen (15) reading passages and five 
(5) items devoted to each passage. Each test will cover the following 
major skill areas with designated subskills: 

1. Meaning Vocabulary (15 items) 



a. Context clues 5 items 

b. Multiple meanings 5 items 

c. Synonyms 5 items 

2. Literal Comprehension (25 items) 

a. Main ideas 5 items 

b. Comparison and contrast 5 items 

c. Details 5 items 

d. Cause/effect 5 items 

e. Sequence • 5 items 

3. Inferential Comprehension (20 items) 

a. Classifying 5 items 

b. Predicting outcomes 5 items 

Character traits 5 items 

a. Comparison and contrast 5 items 

4. Critical Reading/Thinking (15 items) 

a. Fact vs. opinion 5 items 

b. Literary technique 5 items 

c. Appropriateness 5 items 
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Reading Passages > The passages selected for the tests should represent 
interesting and culturally relevant fictional and factual materials. 
The readability of the passages should range progressively throughout 
the tests from two to three grade levels belov the designated ^rade to 
at least one grade level above . 

Mathematics Grade 3^. The basic skills competency mathematics test for 
Grade 3 should cover computation y concepts y and problem-solving skills 
usually expected of students in grades one throug h three and at least 
one grade above . The test will consist of 45 multiple-choice test 
questions (items) devoted to the following skill and subskills areas • 



1. Computation with Whole Numbers (20 items) 



a. Addition (5) 

b. Subtraction (5) 

c. Multiplication (5) 

d. Division (5) 



Problem Solving 
(10 items) 

2 

2 

2 

2 

2 



Mathematics Grade 6^. The basic skills competency mathematics tests 
for Grade 6 should cover computation ^ concepts and problem-solving 
skills usually expected of students in the designated grades and from 
two to three grades below the designated grades and at least one grade 
above. Each test will contain 55 multiple-choice test questions (items) 
devoted to the following skill and subskill areas: 



2. Concepts 3. 
(15 items) 



Numbers/Numeration 3 

Geometry 3 

Measurement 3 

Number Sentences 3 

Graphs/Charts 3 



1. Computation (15 items) 

a. Whole numbers/integers (5) - multiplication & division 

b. Fractions (5) - addition & subtraction 

c. Decimals (5) - addition & subtraction 



2. Concepts 3. Problem Solving 

(24 items) (16 items) 

Number Theory/Numeration 3 2 

Number Sentences 3 2 

Geometry 3 2 

Measurement 3 2 

Graphs/Charts 3 2 

Percents/Money 3 2 

Ratios 3 2 

Probability/Statistics 3 2 
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Mathematics Grade £• The basic skills ccinpetency mathematics tests 
for Grade 8 should cover computation , concepts and problem-solving 
skills usually expected of students in the designated grades and from 
two to three grades below the designated grades and at least one grade 
above. Each test will contain 55 multiple-choice test questions (items) 
devoted to the following skill and subskill areas: 

1. Computation (15 items) 

a. Whole numbers/integers (5) - multiplication & division 

b. Fractions (5) - multiplication fi division 

c. Decimals (5) - multiplication division 



2, Concepts 3, Problem Solving 

(24 items) (16 items) 

Number Theory /Numeration 3 2 

Number Sentences 3 2 

Geometry 3 2 

Measurement 3 2 

Graphs/Charts 3 2 

Percents/Money 3 2 

Ratios 3 2 

Probability/Statistics 3 2 

Writing Grades 3 , 6^ and 8^, Writing is to be tested in Grades 3 , 6 and 8 
beginning in the 1985-86 school year. The purpose of the basic skills 
competency writing tests is to obtain an overall assessment of writing 
skills and to provide educators with helpful diagnostic information. 
Therefore, the State Board of Education has decided to require a direct 
method of assessing writing skills. The tests should take the form of a 
set of directions that invites the students to respond to a question, state 
an opinion, write a letter, explain a process, or recount an event. The 
Grade 8 test will require elements of persuasive writing skills. The time 
allotted for the writing test should allow the student to oraanize ideas, 
write, and edit. Bidders are asked to include in their writing test a 
section to test students* skills as follows: spelling, grammar, punctuation, 
capitalization, • , 

Testing Time 

The total time for any test should not exceed 80 minutes . Thus, on the 
average, students will have about one minute to devote their attention 
to each item. In addition, for readinq and mathematics in Grade 3, it 
should be possible for each test to be broken down into two or three 
shorter testing segments such that actual testing time for students does 
not exceed 30 minutes for any segment. 

Difficulty Level 

Test results from each test for each grade level will be combined 
quantitatively to form a composite score from which the Indiana State 
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Board of Educaticn will detennine funding for the remediation programs. 
Since funds for remediation are expected to support up to 15 percent 
of the total statewide enrollments for each grade, it will be necessary 
to use the 15th statewide percentile on the composite score as the cutoff 
score for funding. The decision to include writing scores as part of 
the composite in Grades 3, 6 and 8 will be based partly on the results 
of pilot testing; however/ the composite score will cover at 'a minimum 
both reading and mathanatics. 

It is extremly important for composite scores to reflect scores considerably 
above chance level. In fact, given the content of the tests and their 
desired diagnostic properties, It is^ desirable for the 15th statewide 
percentile to represent approximately 50 percent of the items correct 
on each test (see Desired Item and Test Characteristics) • 

Test Construction and Calibration 

It is preferred that the test construction process for reading and 
mathematics utilize latent-trait methodology as its primary mode of 
empirical development. It is anticipated that the one-parameter, or 
Rasch, model will suffice; however, the State Board of Education is 
open to consideration of other models that can be shown to provide 
additional benefits without any major loss of other desired test 
properties. Bidders who wish to use classical or traditional test- 
development procedures, p-values, may choose to do so. It is extremely 
important, however, for bidders to specify how test development and 
scaling will proceed. It is also important for the bidders to specify 
the process for identifying and leveling the appropriate writing 
exercises for Grades 6 and 8, 

Desired Item and Test Characteristics 

In order to obtain desirable test characteristics and sufficient 
reliability around the cut-score of the 15th percentile, it is necessary 
that students at the 15th percentile on the average answer correctly 




between 50%_ and 55% of the total number of items on each test , 

ClassicRl testing practice would require creation *iuJ/or selection 
of test: items that have high p-values. According to latent-trait 
or itC'm-response theory, the average item difficulty for all items 
will be near the 15th percentile ability level of all students taking 
the exam. If the third-grade ability (9) continuum (axis) were 
graduated in percentiles for the state, the item characteristic purve 
for a typical, average item would be portrayed as below: 




• (ibility) 
STATEWIDE PERCENTILE lUNKiNG 

Fl9ur« 1 

Of course, with a sufficient number of items in each subskill area, the 
item characteristic curves may fall on one side or the other of the 
15th percentile; however, we would expect that the item difficulty 
levels will qenerally '^cluster" around this ability level. Selecting 
test items around this difficulty level will maximize the information 
(and reliability) of the test at the cut-score point. Therefore, 
another way to look at the desired item characteristics for the average 
third-grader can be depicted by the following item characteristic curve 




e (ibllity) 
STATEWIDE KRCENTIU MNKING 

Figure 2 
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Note that the student of average ability has about an ,85 probability 
of answering the average item correctly. 

National Norms 

It is highly desirable for the tests to have the feature of nat.ional 
notTT^s from which to report test results. While a typical standardized 
(norm-referenced) tef^t would be deemed inappropriate for Indiana's 
purposes, educators and interested parties throughout the State will 
want some type of comparison of state results to those from a 
nationally representative norm group in the designated grades. Acceptable 
methods for obtaining these norms include classical and contemporary 
equating methods; however, the Department of Public Instruction favors 
those capitalizing on latent-trait methodology, 

Objective-Referenced Diagnostics 

The basic elements of the intent of Indiana's basic competency tests 
are fivefold: 

1, CO provide the basis for statev;ide funding of remediation 
programs; 

2, to provide school corporations a partial basis for selecting 
students into the remediation programs; 

3, to provide diagnostic information helpful to those implementing 
the remediation programs; 

4, to retest those studcints participating in the remediation 
programs; and, 

5, to provide information helpful to school corporations as 
they educate all students in the grades designated for testing. 

The second, third and fifth elements in particular call for test results 
that provide appropriate diagnostic information — information that can 
help educators decide who and what needs remediation. 

As is illustrated in the Detailed Content Specifications, the reading 
and mathematics tests are broken down into major skill and subskill 
areas . Each subskill area is to be represented by five test questions 
(items) ; the difficulty of these questions should range moderately, 
and be related to the grade levels at which students usually acquire 
a specific skill (e,g, , most students should succeed on an item measurina 
content taught two years prior to testing, while fewer sho* \d succeed 
at an item measuring a recently taught skill,) With sufficient ranges of 
difficulty, it should be possible for the test results to reflect 
relative status for each test, major skill area, and subskill area, 
hence providing three levels of diagnostic test information. 
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For writing, there will be two levels of test results — total score 
and scores resulting f rcwn the more detailed or diagnostic scoring 
by writing reviewers <> To further the diagnostic process , the State 
Board of Education also prefers that the actual writing sample be 
returned to the student's district, so that the district may then 
share the marked writing sample with teachers and students • 

Scoring and Reporting 

Depending on the type of scaling and on decisions regarding the quantitative 
development of composite scores, the State will require a Funding Report 
that lists corporations with the number of students in each corporation 
that score at or below the 15th statewide percentile on the composite 
score. In addition, the State desires various other reports an^'a scores 
from the basic skills competency tests. Table I lists the rep<;rts, 
scores, and intended recipients of the reports. 

For reading and mathematics, useful and appropriate objectives-referenced 
and normative scoring will be needed for each report. Both statewide 
and national norms will be used where possible and appropriate. 
Averaging and statistical treatments will depend on the type of 
scaling that is chosen. The bidders should adequately describe the 
methods for averaging and statistical analysis related to their 
proposed scales, and include explanation of how they propose to 
develop composite scores. 

For writing, the common scoring approaches for direct assessment include 
holistic, analytic, and primary trait. Each provides different types 
of information about the writing samples scored. The bidders should 
present a rationale for an approach that both provides a total score 
and appropriate diagnostic information. The State Board of Education 
anticipates that each student's writing sample should receive a^ total 
score and at least four subskill scores . The Board also wants the 
writing samples to be returned to the student's district. As with reading 
and mathematics, statewide and national norms are needed. The bidders 
are expected to delineate the methods for scaling, averaging and 
statistical analysis, and to include how they would propose writing 
as part of the composite score. 

Pilot Tests 

Pilot testing will occur during late September prior to the first test 

administration of each test (September of 1984 for Grade-3 tests) . 

The bidders are invited to provide a rationale for choosing 

a grade in which to conduct the pilot. For example, the Grade-3 tests 

could be pilot tested on either third graders or fourth graders.. 

However, late September third graders have little experience as third 

graders. Late-September fourth graders have not only their full experience 



TABLE I 



REPORTS, SCORES AND RECIPIENTS OP REPORTS 
UNDER THE BASIC COMPETENCY TESTING PROGRAM 



REPORT 



SCORES 



RECIPIENTS 
QP REPORT* 



Punding Report 



Test and Item 
Analysis 



Number of students in each DPI 
corporation at or below Corporation 
the 15th statewide per- 
centile on the composite 
ycore. Each corporation 
will need its report for 
claiming funds.** 

Statistical characteristics DPI 
for each tosc, major skill 
area, subskill area, and 
item, including error of 
measurement. 



Summary Statistics 



Group Diagnostic 
Report 



Individual 

Diagnostic/Prescriptive 
Report 

Student List 
Report 



Mean, standard deviation, 
frequency distribution, 
cumulative frequency dis- 
tribution, and statewide 
percentile for each total 
and composite score. 

Average scores by test, 
major skill areas, subskill 
area and item* 

Scores by tests, major 
skill areas, subskill 
areas and item- 
Test scores and composite 
score. 



DPI 

Corporation 



DPI 

Corporation 



Corporation 



Corporation 



Test-Retest 
Group Report 



Average test scores and DPI 
average composite scores. Corporation 



*The bidder will be expected to provide Group Diagnostic and Test-Retest 
Group Reports according to groups defined on a numeric research grid to be 
included on the student response document. 

** The State n-count (multiplied by .15) must be no fewer than the sum of 
all district n-counts of students below the 3 5th statewide percentile score. 
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as third graders, but greater naturatlon to bcr^t. The dilesna, of 
course, arises in the need to pilot well in advance of statewide 
administration of the tests, before March 1, 1985 • For 6th graders, 
the solution may lie in piloting 6th grade tests before March 1, 1985; 
and for 8th graders, March 1, 1986— -one year in advance of statewide 
administration in both instances. The bidders are invited td consider 
these matters and propose a rational solution, especially regarding 
Grade 3. 

The purposes for the pilot tests are threefold: 

1. Verify item and test characteristics and/or form the basis 
for item and test revisions. 

2. Try out testing, scoring, and reporting procedures. 

3. Refine the instruments to discriminate best at the cutoff 
score for the remediation programs. 



Up to 5% of the students (about 3400 for the Grade-3 pilot) will be 
selected for the pilot testing. Bidders should specify exactly how 
they propose to design the pilot tests , including specifics about 
sampling and analyses to meet the above-stated purposes. As a general 
rule, more items should be piloted than are expected in the final 
version of the tests. 

Re testing 

As was indicated earlier, the students selected for participation in 
the remediation programs will need to be retested following remediation; 
i.e., approximately 15% of the students statewide at each grade will 
be retested. The bidders should provide a rationale for how and when 
to conduct retesting that is consistent with the intent of H.E.A. 
1202 and the needs of school corporations. The bidders should also 
realize that school corporations are permitted to operate their remediation 
programs either in the summer or the fall. Once the State knows the 
number of students to be remediated in each corporation, it will submit 
a blanket order to the contractor delineating the number of test 
booklets and/or answer sheets to be delivered to each school corporation. 

Alternate Forms 

Given that the contract is expected to extend over three years, and given 
that the students selected for remediation will need to be retested, 
bidders should propose a plan for the development and use of alternate 
forms for each subject area and grade. 

Format of Test Booklets and Answer Documents 

Bidders should consider the suitability of test-booklet and answer-document 
format for the grades being tested. Grade 3 tests should be in the 
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form of machine-scorable booklets; whereas the tests for Grades 6 
and 8 should use machine-scorable answer sheets that are separate 
from the test booklets. Test booklets should contain both reading 
and mathematics. Provisions for how to format writing tests in 
Grades 6 and 8, however, are left to the bidders to propose. See 
the main body of this RFP for discussions of accompanying manuals 
and supportive materials. 

Item and Test Bias 

As part of the item-selection process, including pilot testing, the 
bidders should indicate how they plan to study and control for cultural, 
racial/ethnic and sex bias among the items that make up the tests. The 
contractor will have to provide evidence from its study of bias. 
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State of 
^lS(piAliA 



Departmtnt of Public Instruction 

Harold H. Neglcy, Supe rinicndcni 

Room 229, State House • Indianapolis 46204 

317/2326610 

lmtrv€ti«fial $«nr}cM for RmmtcIi tfid Aiw m tnt 

Room 229. Sutt Houm 

317/927^213 



MEMORANDUM 

TO: All Superintendents 

FROM: Bill Strange, Director 

RE: Policy Position on Statewide Testing 

DATE: March 16, 198A 



The following policy was adopted by the Commission on General Education, 
State Board of Education, at its March lA, 198A meeting in Evansville: 

!. Statewide t:ests will complement and supplement local tests, 
and not supplant them. 

2. Statewide tests will reflect results reported by national 
assessment (NAEP) , which found that students lack critical 
thinking skills in mathematics problem-solving, reading 
comprehension (inferential), and writing (persuasive). 

3. Statewide tests will reflect a limited domain of learning 
consisting of exit-type basic skills. The term "basic skills" 
includes higher-order, critical thinking skills. 

A. The Commission's determination of minimal passing scores 
will be based on a quota-setting method that takes irito 
account the resources fnr remediation. 

5. Statewide tests ivill be objectives- or criteriori-referenced 
in construction, rather than norm-referenced. 

6. The Commission will delay consideration of a "challenge" 
standard proposed by the Department of Public Instruction 
until after the first vear test results are in. 
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Oifice Loc»!ion: 3833 N. Mtridiin St.. Indiinipolit 



Tryout Participants: Third Grade Reading and Mathematics Subtest 



1. Attica Consolidated School Corporation 
Attica 

2. East Washington School Corporation 
Pekin 

3. Fayette Commanity School Corporation 
Connersville 

4. Fort Wayne Comnunity Schools 
Fort Wayne 

5. Franklin County Community School Corporation 
Brookville 

6. Franklin Township School Corporation 
Lanesville 

7. Frontier School Corporation 
Chalmers 

8. Indianapolis Public Schools 
Indianapolis 

9. Lawrenceburg Camunity Schools 
Lawrenceburg 

10. Loogootee Community Schools 
Loogootee 

11. MSD Decatur Township 
Indianapolis 

12. MSD Mount Vernon 
Mount Vernon 

13. Monroe Central School Corporation 
Parker 

14. Pleasant Township Schools 
Valparaiso 

15. Seymour Comtunity Schools 
Seymour 

16. School Ciiy of East Chicago 
East Chicago 




17 • School City of Hobart 
Hobart 

18. Salem Community Schools 
Salem 

19. South Adams Schools 
Berne 

20. South Madison Ccnwunity SchooJL^^ 
Poidleton 

21. West Lafayette Conmunity Schools 
West Lafayette 
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Tryout Participants: Sixth Grade Test 

!• Blackford County Schools 
Hartford City 

2. Brownstown School Corporation 
Brownstown 

3. Center Grove Ccrmtunity School Corp. 
Greenwood 

4. Clarksville Ccrmtunity Schools 
Clarksville 

5. Evansville-Vanderburgh School Corporation 
Evansville 

6. Franklin Township School Corporation 
Indianapolis 

7. Gary Conmunity Schools 
Gary 

8. Hamnnond City Schools (Reading/Mathematics only) 
Hammond 

9. Huntington County Schools 
Huntington 

10 i Lake Ridge Schools (Writing subtest only) 
Gary 

11. MSD Martinsville 
Martinsville 

12. North VThite Schools 
Monon 

13. Pioneer Regional School Corporation 
Royal Center 

14. Richmond Comnnajnity Schools 
Richmond 

15. Smith-Greene School Corporation 
Churubusco 

16. Wa-Nee School Corporation 
NaH)annee 
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Tryout Participants: Third Grade Writing Subtest 



1. Eastbrook School Corporation 
Marion 

2. Hobart Township Schools 
Hobart 

3. Indianapolis Public Schools 
Indianapolis 

4. Jennings County School Corporation 
North Vernon 

5. Marion Cccmtunity Schools 
Marion 

6. Marion-Adams School Corporation 
Sheridan 

7. Mississinewa Cannnunity Schools 
Gas City 

8. New Prairie United School Corporation 
New Carlisle 

9. Northeast School Corporation 
HyiTiera 

10. North Knox Schools 
Bicknell 

11. Northern Wells CORiTtunity Schools 
Ossian 

12. South Central Conmunity School Corporation 
Union Mills 

13. Valparaiso Ccmmunity Schools 
Valparaiso 

14. Vincennes Conmunity Schools 
Vincennnes 

15. Warrick County Schools 
Boonville 

16. West V7ashington School Corporation 
Cainpbellsburg 
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Holistic and Primary Trait Scoring Systems 



HOLISTIC SCORING 

purpose: Holistic scx)ring assesses the overall quality of a student's 
written product (e.g., short essay) against criterion products representing 
varying levels of quality at the student's grade level. 

PROCEDURE AND SCORING: The student is given a PROMPT, a question designed 
to elicit a focused written response. The length and time allowed to write 
the response are generally left open-ended (Although inposition of length 
and/or time limits might be necessary for logistical reasons, experience of 
other states with writing tests indicates that irtposition of rigid time 
limits tends to depress scores). 

To score responses to a particular prompt, a set of criterion responses 
(called "key papers") is developed. Key papers r^resent variations of 
writing quality at the target grade level, as judged by recognized 
specialists in the field of writing. Generally, these key papers represent 
various levels of quality on several factors, such as writing style, 
organization, mechanics, relevance and organization (note that these 
factors are NOT s^arately scored). The number of quality levels 
established for scoring responses depends on the needs of the test user. In 
Indiana, a four level system (4 = highest quality, 1 = lowest quality) has 
been proposed. 

Each response is scored by at least two trained readers, themselves writing 
specialists. Each reader examines the response and assigns it the numerical 
value of the key paper it is judged to match most closely in terms of 
quality. A response that is incoherent, illegible or totally unrelated to 
the prompt is assigned a score of "0." Readers score responses blindly, 
that is, each does not know the scores assigned by the other. If the 
resulting scores are the same, that score is assigned to the response. If 
the two scores are different, but on the same side of an established cutoff 
score, the average of the two scores is assigned. If the two scores fall on 
opposite sides of the cutoff score, the response is scored by a third reader 
and the three scores are compared. In this case, should the third reader's 
score match one of the first two scores, then that score is assigned. If 
all three scores are different, the readers meet to discuss the response and 
reach concensus regarding its score. However, the need for involvement of a 
third reader is rare if the scoring system is reliable. 

OUTCOME: A single score is assigned to the response, reflecting its overall 
quality, with the highest score representing the highest quality. By 
examining the criteria used in evaluating the response and the content of 
the key papers, a teacher may determine the student ' s strengths and 
weaknesses in writing^ diagnose specific deficiencies cind carry out 
appropriate remedial instruction. 

PRIMARY TRAIT SCORING 
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PURPOSE: The primary trait method assesses the student's ability to 
effectively address a particular audience or accomplish a particular purpose 
through a written product* This ability, which serves as the central 
criterion for evaluating the paper, is termed a "primary trait." In 
addition, the presence of other "secondary" traits may also be evaluated in 
the same paper* However, when multiple traits are evaluated in the same 
response, they are scored separately* 

PROCEDURE AND SCORING: The student is asked to respond to a prcrtpt designed 
to elicit the target primary trait (and any target secondary traits). As 
with the holistic method, students are allowed sufficient time to develop a 
cocrplete response. 

Responses are coitpared with a set of key papers representing different 
degrees to which the target primary and secondary traits are present. The 
scoring procedure is essentially the same as that used for holistic 
evaluation, in that responses are independently evaluated two trained 
readers and assigned a single score for each target trait ^ according to the 
response's "best match" with a key paper. 

OUTCOME: A single score is assigned to the response, based on the degree to 
which the trait is present, that is, how effectively the writer ccmmunicates 
to the audience or accomplishes the particular purpose of the response. By 
exmaining the content of the response against the key papers, a teacher may 
determine the student's strengths and weaknesses on th^ target trait/s and 
plan appropriate remedial instruction. 
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